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I.  INTRODUCTION 


Although  the  Air  Force  accident  rate  in  recent  years  has  been  at  an  all  tin>e 
low,  many  feel  an  even  lower  rate  could  be  achieved  by  reducing  the  number  of 
controlled  flight  into  terrain  (CFIT)  accidents,  which  constitute  the  second 
largest  category  of  Tactical  Air  Force  (TAF)  Class  A  mishaps.  Air  Force 
investigations  concluded  that  between  1975  and  1981  there  were  56  fighter  and 
attack  aircraft  involved  in  CFIT  accident  mishaps.  The  United  States  Navy  has 
attributed  the  loss  of  317  aircraft  to  CFIT  accidents  between  1970  and  1984. 
Although  the  occurrence  of  CFIT  could  be  greatly  reduced  in  the  tactical  fleet  by 
installing  forward  looking  Terrain  Following  Radar  (TFR)  systems,  such  a  solution 
would  be  prohibitively  expensive  and  possibly  unnecessary.  Since  a  significant 
percentage  of  CFIT  accidents  occur  during  low  level  missions  while  flying  over 
sloping  terrain  that  is  not  particularly  severe,  it  has  been  proposed  that  a  leas 
costly  solution  to  the  problem  could  be  based  on  less  complicated  sensors  (e.g.,  a 
radar  altimeter  system)  that  would  cover  a  part  of  the  CFIT  envelope  instead  of 
all  of  it. 

Such  an  approach  has  been  highly  successful  on  commercial  airliners  and  some 
wide  body  military  transports  which  are  equipped  with  a  Ground  Proximity  Warning 
System  (GPWS).  The  CFIT  accidents  for  comnercial  aircraft  have  in  fact  dropped  to 
virtually  zero  since  1976,  when  GPWS  use  was  mandated  by  the  Federal  Aviation 
Administration.  However,  the  much  more  complex  nature  of  tactical  application 
cannot  be  accommodated  by  the  system  currently  available  in  commercial  and  wide 
body  aircraft. 

In  an  effort  to  develop  a  Ground  Collision  Avoidance  System  (GCAS)  for  F-16 
aircraft,  General  Dynamics  has  developed  a  "Ground  Clobber"  algorithm  designed  to 
provide  a  warning  to  the  pilot  in  the  event  of  an  impending  CFIT  mishap.  The  F-16 
System  Program  Office  requested  that  the  Crew  Station  Design  Facility  investigate 
General  Dynamic's  algorithm  over  a  variety  of  tactical  maneuvers. 


IE.  BACKGROUND 


In  an  effort  to  determine  the  capabilities  of  existing  CFLT  avoidance 
algorithms,  the  CSDF  decided  to  evaluate  three  different  algorithms: 
General  Dynamics'  Ground  Clobber  (GC)  Algorithm,  Cubic's  Ground  Collision 
Avoidance  (GCAS)  Algorithm,  and  Fairchild's  Low  Altitude  Warning  System 
(LAWo)  Algorithm.  In  this  section  the  focus  will  be  on  the  similarities 
and  differences  of  these  three  algorithms. 

General  Dynamics'  GC  Algorithm  is  the  only  one  of  the  three  evaluated 
that  provided  an  alert  visual  cue  to  adviae  the  pilot  of  an  impending 
"pull-up"  warning.  The  algorithm  continuously  compares  aircraft  height 
above  the  ground  with  the  altitude  required  for  dive  recovery,  predicting 
altitude  lots  during  dive  recovery  as  a  sum  of  the  following: 

a.  Altitude  loss  due  to  pilot  response  time. 

b.  Altitude  loss  during  roll  recovery. 

c.  Altitude  loss  during  a  4-G  pull-up. 

The  Ground  Clobber  Algorithm  also  has  a  50  foot  buffer  resident  within  the 
system. 

The  Cubic  GCAS  Algorithm  is  the  only  one  of  Che  three  algorithms 
evaluated  that  allowed  the  pilot  to  select  set  clearance  plane.  Such  a 
feature  allows  the  pilot  to  determine,  at  his  discretion,'  an  appropriate 
clearance  altitude.  This  algorithm  continuously  compares  the  aircraft's 
present  height  above  the  ground  with  the  altitude  required  for  dive 
recovery  and  predicts  altitude  loss  during  dive  recovery  as  a  sum  of  the 
following: 

a.  Altitude  loss  due  to  pilot  response  time. 

b.  Altitude  loss  during  roll  recovery. 

c.  Altitude  loss  during  a  5-G  pull-up. 

d.  Altitude  loss  due  to  terrain  rise  during  the  pull-up. 

The  GCAS  algorithm  differs  from  the  GC  algorithm  in  two  distinct 
ways.  First,  it  is  based  on  a  5-G  pull-up,  while  the  GC  algorithm  is 
based  on  a  4-G  pull-up.  Secondly,  the  GCAS  algorithm  calculates  the 
altitude  loss  due  to  ground  rise  using  a  filtered  estimation  of  the 
terrain  slope  directly  below  the  aircraft.  The  GC  algorithm  does  not 
estimate  terrain  slope.  Further  information  on  the  mechanization  of  these 
algorithms  can  be  found  in  Appendix  A. 

The  LAWS  algorithm  differs  in  philosophy  from  either  of  the  previous 
two  algorithms.  Based  on  maximum  G's  available  rather  than  on  a  set  G 
pull-up,  this  algorithm  is  inher  ntly  more  aggressive  the.:  the  prior  two. 
The  G's  available  are  based  upon  the  weight,  wing  area,  coefficient  of 
lift,  and  dynamic  pressure.  The  maximum  G  calculated  is  limited  by  an 
"if"  statement  which  can  be  changed  to  accommodate  any  value  of  maximum. 
For  this  evaluation,  the  G  limit  was  not  changed  from  the  A-LO  value  of  9 
G's.  A  built-in  minimum  altitude  of  90  feet  provides  a  pull-up  warning  at 
any  instance  the  radar  altitude  is  90  feet  or  less.  (This  minimum  design 
altitude  was  tied  to  the  filtered  radar  altimeter,  and  under  certain 
conditiono  lagged  behind  the  radar  altimeter.  This  resulted  in  the 
masking  of  some  MDA  warnings,  but  hod  no  effect  on  the  report's  crash 
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data.)  The  LAWS  Warning  Algorithm  also  includes  a  predictive  warning 
calculation.  This  predicCive  portion  issues  a  warning  based  on  a 
prediction  of  the  time  necessary  for  recovery  based  on  pilot  reaction 
time,  flight  path  angle,  bank  angle,  airspeed,  minimum  design  altitude, 
and  terrain  slope.  A  major  difference  between  the  LAWS  algorithm  and  the 
other  two  algorithms  is  the  extensive  inhibit  logic  used.  Appendix  A 
contains  additional  information  on  the  LAWS  algorithm  mechanization  and 
predictive  warning  inhibita. 


III.  PURPOSE 


The  overall  objective  of  this  simulation  study  was  to  evaluate  the 
G>  uud  Clobber  algorithm  in  a  variety  of  tactical  scenarios.  The  study 
was  specifically  designed  to  provide  data  which  could  be  used  to: 

a.  Evaluate  the  adequacy  of  the  algorithm  to  provide  a  warning  in 
sufficient  time  for  a  pilot  to  recover  in  a  variety  of  CFIT  scenarios. 

b.  Compare  the  GC  Algorithm  to  the  LAWS  and  GCAS  Algorithms. 

c.  Evaluate  the  impact  and  incidence  of  nuisance  warnings  generated 
by  each  of  the  three  algorithms. 

d.  Assess  pilot  reaction  to  each  of  the  three  algorithms. 


k 
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IV.  METHOD 


APPARATUS 


Experimental  facility.  This  applied  experimental  research  was 
conducted  at  the  Grew  Station  Design  Facility  (OSDF),  an  Air  Force  flight 
simulation  facility  which  belongs  to  the  Aeronautical  Systems  Division 
(ASD)  of  Air  Force  Systems  Command  (AFSC)  at  Wright-Patterson  AFB  Ohio. 

The  personnel  at  the  CSDF  conduct  human  engineering  studies  in  support  of 
a  variety  of  System  Program  Offices  (SPOs).  The  facility  currently 
includes  an  F-16,  an  A-10,  and  a  KC-135  cockpit  simulator  and  an  extensive 
computer  complex.  Its  two  visual  systems  are  capable  of  simulating  day 
and  night  time  visual,  LANTIRN,  and  FL1R. 

F-16  Simulator.  The  CSDF  F-16  flight  simulator  was  used  as  the  test 
vehicle  for  this  study.  The  simulator  itself  was  constructed  using  a 
salvaged  single-seat  F-16  cockpit  truncated  from  in  front  of  the  forward 
windscreen,  to  approximately  fifty-seven  inches  behind  the  canopy  hinge. 
The  undercarriage  has  been  removed,  and  the  base  of  the  simulator  sits  on 
wheels.  The  simulator  does  not  employ  a  motion  base.  The  cockpit 
controls  and  displays  are  configured  to  the  F-16  Multi-National  Staged 
Improvement  Program  (MSIP)  Block  40  design.  This  all-digital  design 
includes  two  4x4  inch  multi-function  displays  (MFDs),  a  wide 
f ield-of-view  (WFOV)  raster  video  head-up  display  (HUD),  an  integrated 
control  panel  (ICP),  a  data  entry  display  (DED),  hands  on  stick  and 
throttle  controls,  centralized  flight  instruments,  and  the  LANTIRN 
avionics  suite  (terrain  following,  radar  altimeter,  FLIR).  The  stick, 
throttle,  and  flight  instruments  are  actual  F-16  components.  However,  all 
of  the  other  instruments,  controls,  and  displays  are  simulated  using 
locally  available  equipment.  The  aft  section  of  the  simulator,  in  the 
area  formerly  occupied  by  fuel  cells,  now  contains  the  microprocessor 
racks  which  encompass  the  advanced  simulator  technology  (AST)  interface. 
The  microprocessors  operate  the  controls  and  displays,  while  two  fifty-pin 
ribbon  cables  connect  the  simulator  to  the  mainframe  computers  which 
perform  the  aerodynamic  calculations.  The  combination  of  F-16  real  and 
simulated  instrumentation,  the  fully  operational  controls  and  displays, 
the  realistic  visual  terrain  and  HUD,  and  the  actual  cockpit  work  together 
to  create  a  high  fidelity  replica  of  the  F-16  MSIP  cockpit.  The 
aerodynamic  model  is  the  same  one  that  is  used  for  aircrew  training,  and 
its  validity  has  been  demonstrated  in  a  number  of  prior  experiments.  The 
primary  flight  controls,  the  terrain  model  visual  system,  and  the 
simulated  HUD  were  the  main  components  used  in  this  study.  A  synthesized 
voice  warning  system  was  used  to  transmit  digitized  warnings  (pull-up, 
pull-up)  to  the  pilot  for  each  warning  event. 

Computer  Complex.  The  computer  complex  at  the  CSDF  consists  of  one 
Gould  Concept  32/8780 and  four  GouLd  Series  32/7780  mainframe  computers, 
PDPU/34  and  li/35  computers,  and  various  graphics  computers.  All 
aircraft  aerodynamics  and  aircraft  systems  were  computed  on  the  mainframe 
computer  complex.  Performance  data  collected  on  each  mission  were  taken 
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from  eh-,  mainframe  compurers  and  recorded  on  magnetic  tape  for  subsequent 
review  and  analyses. 


Visual  System.  An  nut-of-the-cockpit  visual  scene  was  provided 
using  a  closed  circuit  TV  system  from  a  modified  Link  SMK-23  moving 
terrain  model.  Each  of  the  two  belts  replicates  a  23  x  15  nautical  mile 
section  of  central  Pennsylvania.  The  landscape  was  carved  from  foam, 
using  a  digitized  data  base  in  a  computer  driven  milling  machine.  The 
foam  was  glued  to  the  15  foot  high  moving  canvas  belt,  painted,  and 
finished  with  individually  applied  cultural  features.  The  particular 
section  of  Pennsylvania  used  for  the  terrain  boards  was  chosen  because  it 
provided  a  wide  variety  of  terrain  in  a  relatively  small  area.  The  belt 
itself  moves  in  a  north  or  south  direction,  while  the  camera  moves  east  or 
west  on  a  gantry.  '.Che  head  of  the  camera  can  also  move  in  and  out 
relative  to  the  boards,  simulating  altitude.  This  provides  simulated 
aircraft  visual  parameters  of  360  degrees  continuous  heading,  36C  degrees 
of  continuous  roll  plus  or  minus  120  degrees  of  pitch,  and  50  tc  4000  feet 
of  altitude.  The  visual  apparatus  consists  of  a  Cohu  high  resolution,  low 
light  level  TV  camera  and  a  Farrand  optical  probe.  The  picture  is 
transmitted  to  a  Conrac  100  line  black  and  white  TV  monitor  through  a  beam 
splitter  to  a  parabolic  mirror  with  a  focal  length  of  54  inches.  This 
combination  gives  the  pilot  approximately  a  48  degree  forward 
field-c' -view  (FOV)  collimated  to  appear  at  infinity. 

Head-up  Piaplay.  The  LANTIRN  HUD  simulation  is  created  by  using  the 
model  employed  to  verify  the  production  design.  This  model  not  only 
requires  the  pilot  to  look  in  exactly  the  same  place  in  the  aircraft,  but 
also  within  the  same  area  and  around  the  same  obstructions.  The  control 
panel  was  built  and  interfaced  through  software  programing  to  provide 
full  control  of  the  HUD  symbology.  A  Vector  General  symbol  generator 
displays  the  caligraphic  symbology,  while  a  PDP  11/34  maps  and  controls 
the  HUD's  position.  The  Gould  mainframe  computers  send  the  flight 
parameters  to  the  Fl)P  computer  to  enable  it  to  position  the  symbology 
within  the  raster  video  scene  so  that  the.  pilot  can  use  the  HUD  and  the 
imbedded  symbology  to  control  the  simulator. 

Experimenter's  Console.  The  experimenter's  console  provides 
controls  and  displays  for  mission  setup,  simulator  operation,  data 
collection  equipment,  and  various  control  and  display  mechanization 
options.  For  this  evaluation  there  were  three  options  available  to  the 
experimenter  to  change  simulator  position  and  attitude.  One  option 
allowed  the  console  operator  to  move  the  simulator  forward  3000  feet  in 
the  flight  plan  to  simulate  a  late  pop  on  weapons  delivery  runs.  When 
this  occurs  in  the  real  world,  the  pilot  finds  himself  outside  optimum 
delivery  parameters;  the  target  ia  more  difficult  to  find,  and 
corrections  require  a  steeper  than  normal  delivery  angle.  This  feature 
was  used  on  Missions  15  and  17  to  complicate  the  delivery  task. 

Another  option  allowed  the  operator  to  decrease  simulator  altitude  in 
increments  of  1000  feet.  This  was  used  on  Mission  16  to  simulate  entry 
into  dynamic  maneuvers  ac  a  iower  than  expected  altitude.  This  led  to 
unexpected  CFIT  warnings  in  attitude  and  flight  path  conditions 
approaching  the  limits  of  system  operation,  and  in  some  cases, 
disorientat ion. 

The  final  option,  dealing  with  siniilator  control,  required  the  use  of 
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a  joy  stick  on  che  console  to  operate  in  series  with  the  pilot's  control 
stick.  With  this  capability,  the  experimenter  could  change  aircraft  pitch 
and  roll  attitudes  during  periods  of  pilot  distraction  to  simulate  entry 
into  unusual  (or  unexpected)  attitudes.  This  control  feature  was  used 
effectively  during  low  level  navigation  and  high  "G"  turning  flight  when 
pilots  were  instructed  to  read  authentication  and  alphanumeric  cards. 


SUBJECT8: 


A  total  of  eight  pilots  participated  in  the  study.  Five  were 
operational  pilots  from  the  Tactical  Air  Command  (TAC),  and  three  were 
pilots  from  Wright-Patterson  AFB  with  previous  Tactical  experience  in  the 
low  level  environment.  All  the  pilots,  except  one  from  TAC,  had  previous 
F-16  experience.  The  pilotB  had  varying  amounts  of  flight  time  in  the 
F-16  as  indicated  in  Table  1.  The  pilots  arrived  over  a  course  of  a 
month,  with  an  average  of  two  pilots  participating  each  week. 


TABLE  1.  Pilot  Experience 


Subject  Number 

Time 

Total  flying  time  (hrs.) 

Total  F-16 

1 

3100 

700 

2 

1600 

300 

3 

500 

100 

4 

3000 

200 

5 

2000 

600 

6 

2800 

0 

7 

29  50 

600 

8 

1700 

350 

EXPERIMENTAL  DESIGN: 


The  experimental  design  was  a  repeated  measures  three  by  three 
design,  with  algorithm  and  mission  type  as  the  independent  variables. 

There  were  three  algorithms:  GCAS,  LAWS,  and  GC.  There  were  also  three 
separate  types  of  missions  (descriptions  follow).  Each  pilot  acted  as  his 
own  control.  Subjects  were  randomly  assigned  to  the  conditions. 


Mimoni.  Three  missions  were  selected  co  test  the  algorithms.  The 
overall  objective  in  designing  the  profiles  was  ‘:o  subject  the  pilot  to  a 
variety  of  conditions  representative  of  those  encountered  in  tactical 
fighter  operations,  with  specific  emphasis  on  the  kinds  of  situations 
reported  in  CFIT  incidents.  A  brief  description  of  each  mission  follows; 
additional  details  are  provided  in  Appendix  B. 

a.  Low  Level  Navigation/Pop-up  Deliveries  (Mission  15).  This 
mission  was  flown  at  300-500  feet  above  the  terrain  at  approximately  480 
knots  ground  spaed.  Some  segments  of  the  route  were  flown  over  relatively 
level  terrain  between  ridges,  simulating  typical  terrain  masking 
operations.  Other  segments  required  ridge  crossings  and  flight  over  rough 
terrain.  Three  targets  located  along  the  route  of  flight  were  used  for 
pop-up  weapons  deliveries.  Pop-ups  were  initiated  20  seconds  prior  to  the 
target  to  allow  20-30  degree  dive  deliveries.  The  experimenter  could 
advance  the  simulator  in  the  pop  so  that  the  aircraft  would  be  outside 
normal  delivery  parameters  in  the  pull-down. 

b.  Instrument  Meteorological  Conditions  (IMC)  Maneuvering  (Mission 
16).  This  mission  consisted  of  a  series  of  aerobatic  maneuvers  flown 
under  IMC.  These  maneuvers  required  the  pilot  to  recover  from  relatively 
extreme  pitch  and  bank  attitudes  similar  to  what  he  might  encounter  during 
unusual  attitude  or  spatial  disorientation  incidents.  During  some  of  the 
maneuvers  (the  loop,  split  S,  and  Cuban  8),  the  experimenter  adjusted 
simulator  altitude  3000' -4000'  to  cause  early  and  unexpected  altitude 
alarms. 


c.  Range  Mission  and  Hard  Turns  at  Low  Altitude  (Mission  17).  The 
first  half  of  this  mission  consisted  of  three  runs  on  the  same  target  from 
two  different  headings  -  simulating  a  low  level  range  familiarization 
flight.  Like  Mission  15,  delivery  maneuvers  consisted  of  a  30  degree 
straight-ahead  pop  at  20  seconds  prior  to  the  target,  s  climb  to  4000  feet 
Mean  Sea  Level  (MSL)  and  a  roll  to  inverted  flight  for  the  pull  down  to  a 
20-30  degree  dive.  Bomb  release  was  briefed  to  be  completed  at  2500  feet 
MSL. 


The  second  half  of  Mission  17  was  flown  over  essentially  level 
terrain  at  480  kts.  in  a  figure  eight  pattern  between  two  steerpoints.  At 
each  steerpoint  passage,  Che  pilot  initiated  a  5  ' G '  turn  of  about  210 
degrees  to  simulate  defensive  maneuvering  at  low  level  (300'-500’). 

During  the  turns,  pilots  were  asked  to  read  a  series  of  numbers  and 
letters  from  a  card  located  on  the  canopy  over  head  to  simulate  checking 
their  6  o'clock  position  for  other  aircraft.  Reductions  to  aircrsft 
altitude  were  made  by  the  experimenter  during  the  turns  on  this  mission  to 
further  complicate  the  recovery  task. 


Teat  Procedure.  When  the  pilots  arrived  to  participate  in  the 
study,  they  were  asked  to  fill  out  a  personal  data  questionnaire  (Appendix 
C).  They  were  then  given  a  general  briefing  on  the  facility  and 
experiment,  and  a  specific  briefing  on  each  of  the  three  algorithms  (GC, 
GCAS,  and  LAWS).  They  then  moved  to  the  vault  for  ground  school  on  the 
F-16  simulator,  and  were  given  an  opportunity  to  fly  a  training  mission 
for  practice  to  conclude  the  initial  half  day  period.  In  the  following 
half  and  full  day,  the  pilots  flew  10  missions  in  which  data  were 


8 


collected-  The  three  algorithms  over  the  three  missions  accounted  for 
nine  of  these  missions.  The  tenth  mission  consisted  of  an  enhanced  GC 
algorithm  flown  over  just  Mission  15.  The  last  half  day  allowed  the 
experimenter  to  complete  any  additional  or  make-up  missions  required,  to 
de-brief  the  pilots,  and  to  administer  the  final  questionnaire.  A 
detailed  schedule  of  events  for  each  pair  of  pilots  is  in  the  Appendix  C. 


Dynamic  Evaluation.  After  completing  the  simulator  orientation 
training,  flying  the  practice  mission,  the  pilots  returned  to  the  pilot 
briefing  room  where  they  took  part  in  a  mission  planning  session.  Mission 
briefings  prior  to  each  data  collection  flight  covered  the  overall  mission 
scenario,  specific  objectives  of  the  mission,  altitudes,  speeds,  times, 
etc....  Pilots  were  also  provided  with  a  mission  setup  checklist  and  a 
strip  map  of  the  route  of  flight  when  appropriate.  The  subject  pilot  then 
moved  back  to  the  simulator  to  conduct  tha  actual  experiment.  After  the 
pilot  completed  cockpit  setup  actions,  reviewed  the  mission,  checked  the 
headset  audio,  closed  the  canopy,  and  indicated  that  he  was  ready  to  start 
the  run,  the  simulator  and  data  recording  equipment  were  activated  and  the 
mission  was  started.  Voice  communications  were  held  to  a  minimum  during 
each  evaluation  run  and  were  limited  to  responding  to  the  pilot's 
questions  or,  as  was  the  case  with  Missions  13  and  17,  recording  his 
assessment  of  the  validity  of  algorithm  warnings ,  since  these  were  the 
only  missions  where  he  was  in  a  position  to  assess  the  validity  of  the 
warning.  On  these  missions  pilots  were  asked  to  rate  the  warning  a a  valid 
or  invalid  (either  late  or  early). 


Date  Collection  and  Hsasstsssnt.  A  variety  of  flight  parameters 
were  recorded  on  the  mainframe  computers  for  each  mission.  Table  2  lists 
the  flight  parameters  which  were  recorded,  their  unit  of  measurement,  snd 
their  range.  At  the  conclusion  of  each  individual  mission,  the  pilot 
completed  a  short  questionnaire.  An  overall  questionnaire  wsb 
administered  at  the  end  of  the  experiment. 


TABLE  2.  FLIGHT  PARAMETEKS 


FLIGHT  PARAMETERS  UNIT 

Pitch  Attitude 
Roll  Attitude 
"G"  Load 

Flight  Path  Angle 

Pitch  Rate 

Absolute  Altitude 

Barometric  Altitude 

Heading 

Roll  Rate 

Yaw 

Terrain  Angle 

GCAS  Triggered  Pull-up  Time 

GC  Triggered  Pull-up  Time 

LAWS  Triggered  Pull-up  Time 

Altitude  at  Pull-up  Alarm 
(all  three) 

Altitude  Clearance  at  PulL-up 
(all  three) 

Engine  RPM 

Grounds  peed 

True  Airspeed 

Angle  of  Attack 

Stick  force 

Time  from  Signal  to  Change 
in  Stick  Force 


OF  MEASUREMENT 

RANGE 

de grees 

♦  90 

de grees 

♦  180 

"G" 

-3  to  +  10 

degrees 

+  90 

degreea/aecond 

♦  45 

feet 

0  to  1000 

feet 

0  to  6000 

degrees 

0  to  360 

degrees /second 

+  75 

degrees 

1  45 

degrees 

1  60 

seconds 

discrete 

seconds 

discrete 

seconds 

discrete 

feet 

discrete 

feet 

discrete 

ZRPM 

idle  to  95 

knots 

0  to  600 

knots 

0  to  600 

degrees 

lbs 

discrete 

seconds 

Following  each  simulated  mission,  a  short  debriefing  session  provided 
an  opportunity  for  the  experimenter  and  evaluation  pilot  to  discuss 
simulator  and  algorithm  operation.  During  these  sessions  the  experimenter 
recorded  pilot  comments  on  the  algorithm  operation  as  it  applied  to  thi> 
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mission  just  flown.  The  post  mission  questionnaire  also  evaluated  missed 
warnings,  early  or  late  warnings,  and  nuisance  warnings.  These 
questionnaires  were  Later  compiled  by  algorithm  type  and  are  described  in 
the  results  section.  Questions  and  their  suntnary  results  are  included  in 

Appendix  C. 


V.  RESULTS 


The  parameters  described  in  Table  2  allow  reconstruction  of  Che  flights 
for  more  definitive  evaluation.  The  critical  flight  parameters  were 
plotted  as  time  histories  for  each  maneuver  resulting  in  a  crash.  The 
data  were  plotted  from  a  period  of  ten  seconds  prior  to  the  crash  to  five 
seconds  sftar  the  crash,  to  show  beginning  and  ending  conditions  for  each 
event  for  subsequent  analysis  and  assessment  of  pilot  performance. 

Since  the  three  algorithms  were  resident  in  the  system  and  all  thr~-a 
could  be  run  concurrently,  warnings  were  generated  off-line  for  the  two 
algorithms  not  in  uBe  for  a  particular  mission.  Using  this  technique, 
warnings  from  two  and  sometimes  all  three  systems  under  essentially 
identical  flight  conditions  could  be  evaluated  off-line. 


EXPERIMENTAL  PERFORMANCE  DATA 


Two  series  of  data  were  collected  during  the  course  of  this 
experiment.  In  the  first  series,  baseline  data  were  collected  from  a 
sin  gle  pilot,  under  controlled  conditions. 


Baseline  Dive  Recovery  Performance 


a.  Basic  Algorithm  Performance.  In  an  effort  to  establish  some 
baseline  data  on  each  of  the  three  algorithms,  one  set  of  runs  was  made 
against  a  perfectly  level  terrain  base  at  -  2.S  degrees,  -  10  degrees,  -20 
degrees,  -30  degrees  snd  -AO  degrees  flight  path  angles,  first  in  a  wings 
level  attitude,  and  then  at  50  degrees  of  bank.  In  order  to  obtain 
consistent  data,  power  was  set  to  approximate  that  required  to  maintain 
A80  KCAS  at  the  start  of  each  descent.  This  resulted  in  increasing  speed 
during  each  run  with  the  rate  of  speed  increase  higher  at  the  higher 
flight  path  angles.  All  runs  were  flown  manually  so  slight  variations  in 
flight  path  angle  and  bank  occurred.  The  data  shows,  however,  that  these 
variations  were,  for  the  roost  part,  less  than  1  degree.  Table  3  gives 
the  warning  altitudes  and  recovery  altitudes  in  feet  for  each  of  the  given 
conditions.  Table  3a  shows  wings  level  results  and  Table  3b  shows  results 
from  50  degree  bank  descents. 
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TABLE  3 


Baseline  Dive  Recovery  Performance 


TABLE  3a.  Wings  Level 


GC 

GCAS 

LAWS 

FPA 

WARD 

RECOVER 

G 

WARN 

RECOVER 

G 

WARN 

RECOVER 

G 

DEG 

-2.5 

109 

88 

3.7 

92 

53 

3.5 

90 

43 

6.3 

-10 

628 

419 

5.3 

501 

276 

6.1 

266 

40 

5.1 

-20 

1973 

1360 

6.4 

1353 

597 

7.4 

736 

123 

8.0 

-30 

3647 

2529 

7.1 

2593 

1409 

7.8 

1366 

198 

8.6 

-40 

5794 

3943 

7.1 

2477 

731 

8.2 

2303 

570 

8.9 

TABLE 

3b. 

50  degrees  beak 

GC 

GCAS 

LAWS 

FPA 

WARN 

RECOVER 

G 

WARN 

RECOVER 

G 

WARN  ' 

RECOVER 

G 

DEG 

-2.5 

100 

83 

3.3 

123 

75 

3.9 

90 

34 

7.8 

-10 

647 

418 

4.7 

633 

394 

5.6 

413 

175 

6.4 

-20 

2129 

1425 

5.3 

1649 

990 

6.3 

880 

249 

*.7 

-30 

3740 

2370 

7.1 

2741 

1544 

5.9 

1489 

436 

7.0 

-40 

5929 

3731 

6.2 

4509 

2216 

6.8 

2482 

372 

6.9 

Note  in  Che  tables  that  warning  altitudes  for  each  algorithm  are 
fairly  repeatable.  Comparing  the  three  algorithms,  LAWS  consistently 
provided  warnings  at  lower  altitudes  both  with  and  without  bank  angle. 

This  in  turn  led  to  Lower  recovery  altitudes.  Ground  Clobber  typically 
provided  the  highest  warning/recovery  altitudes  of  the  three,  with 
recovery  altitudes  as  high  as  3943  feet. 

Maximum  "G"  attained  on  each  run  was  included  in  the  tables  to  place 
recovery  altitudes  in  proper  perspective.  Obviously,  considerable 
variation  in  altitude  loss  in  a  recovery  occurs  with  variations  in  max  "G" 
and  rate  of  "G"  onset. 

Note  that  in  most  cases  system  design  "G"  forces  were  exceeded  during 
some  part  of  the  recovery.  As  explained  earlier  in  this  report,  the 
Ground  Clobber  Algorithm  is  based  on  a  4-G  recovery,  GCAS  on  5-G  and  LAWS 
on  ae  much  "G"  as  the  pilot  can  get.  The  limited  "G"  algorithms  (GC  and 
GCAS)  are  more  consistent  with  F-16  stores  limitations  in  that  they  are 
based  on  a  4-5  "G"  maneuvering  recovery.  LAWS,  on  the  other  hand,  ia 
designated  mori  ae  a  last  chance  recovery  warning  and  requires  the  use  of 
more  "G".  In  this  context,  experience  with  the  systems  wiLl  show  that 
LAWS  will  usually  lead  to  exceeding  stores  "G"  limits. 
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b.  Latest  Algorithm  Comparison.  Subsequent  to  the  formal 
evaluation,  personnel  from  Cubic  Corporation  arrived  to  collect  additional 
performance  data  and  to  make  modifications  to  their  basic  GCAS  algorithm. 
On  the  day  before  they  left,  we  were  asked  to  check  out  what  turned  out  to 
be  a  fairly  significant  recovery  algorithm  change.  In  order  to  measure 
and  record  the  effects  of  this  change,  we  flew  the  same  series  of 
controlled  descents  using  the  new  algorithm.  Results  of  these  runs  are 
shown  in  Tables  4a  and  4b.  We  have  included  in  these  Tables  the  same 

Ground  Clobber  and  LAWS  data  shown  previously  to  allow  the  reader  to 
compare  performance  across  the  three  systems. 


Tabla  4.  Recovery  Comparison  with  Latest  GCAS  Algorithm 


TABLE  4a.  Wings  lcvel/flat  earth 


FPA 

GC 

GCAS 

LAWS 

( -DEG) 

WARN 

RECOVER 

G 

WARN 

RECOVER 

G 

WARN 

RECOVER 

G 

2.5 

109 

88 

3.7 

151 

103 

3.3 

90 

43 

6.3 

10 

628 

419 

5.3 

422 

212 

5.0 

266 

40 

5.1 

20 

1973 

1360 

6.4 

909 

206 

6.4 

736 

123 

8.0 

30 

3647 

2529 

7.1 

1222 

199 

7.2 

1366 

198 

8.6 

40 

5794 

3943 

7.1 

2095 

283 

5.5 

2303 

570 

8.9 

TABLE 

4b. 

50  Degree 

Bsak/f let 

earth 

FPA 

GC 

GCAS 

LAWS 

( -DEG ) 

WARN 

RECOVER 

G 

WARN  I 

RECOVER 

G 

WARN 

RECOVER 

G 

2.5 

100 

83 

3.3 

154 

112 

3.6 

90 

34 

7.8 

10 

647 

418 

4.7 

445 

132 

4.7 

413 

175 

6.4 

20 

2129 

1425 

5.3 

1021 

234 

5.8 

880 

249 

6.7 

30 

3740 

2370 

7.1 

1696 

276 

6.3 

1489 

436 

7.0 

40 

5929 

3731 

6.2 

2303 

484 

6.0 

2482 

372 

6.9 

Note  that  in  these  Tables  the  modified  GCAS  algorithm  now  closely 
parallels  LAWS  performance,  where  previously  it  was  quite  similar  to 
Ground  Clobber. 

Another  recent  modification  to  GCAS  is  a  type  of  reasonableness  check 
that  requires  three  consecutive  iterations  of  the  algorithm  prior  to 
issuing  a  warning.  This  is  similar  in  some  respects  to  the  0.5  sec  delay 
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proposed  for  Enhanced  Ground  Clobber  and  is  intended  to  prevent  nuisance 
warnings  triggered  by  flight  over  irregular  terrain. 

Another  moaification  delays  warnings  when  the  aircraft  is  in  near 
level  flight  with  less  than  1  G.  This  was  done  to  further  reduce  the 
number  of  nuisance  warnings  during  ridge  clipping.  From  what  we  have  aeen 
thus  far,  this  has  been  effective  when  the  pilot  is,  in  fact,  ridge 
clipping.  The  disadvantage  of  course  is  that  it  further  reduces  valii’ 
warnings  if  the  pilot  pushes  too  esrly  topping  a  ridge,  or  if  "G"  is 
reduced  to  lesa  than  one  in  near  level  flight  over  level  or  slowly  rising 
terrain. 


SCATTER  PLOTS 

The  performance  date  used  to  generate  the  plots  were  obtained  from 
the  experimental  missions  flown  by  the  eight  subject  pilots.  In  the  first 
series  of  plots,  vertical  velocity  was  recorded  for  each  warning  along 
with  the  total  altitude  lost  during  recovery.  Three  plots  resulted,  one 
for  each  of  the  algorithms.  As  expected,  the  altitude  loss  increased  with 
increasing  vsrticsl  velocity  in  all  three  eases  (Figures  1,  2,  and  3). 
Focusing  on  the  lines  of  best  fit  in  each  figure  does  not  indicate  that 
any  of  tha  algorithms  perform  uniquely.  The  GCAS  figure  does  show  more 
dispersion  of  data  points,  sapecially  at  lower  vertical  velocities.  This 
could,  however,  be  attributed  to  a  variety  of  factors  to  include 
potentially  higher  bank  angles  or  warnings  over  differing  terrain 
profiles.  It  is  important  to  realize  that  each  warning  may  represent  very 
different  flight  and  terrain  conditions.  The  figures  nonetheless  provide 
comparative  trend  data. 

In  the  second  secias  of  plots  (Figures  4,  5,  and  6),  flight  path 
angle  was  recorded  for  each  warning  along  with  the  total  altitude  lost 
during  recovery.  Ones  again  the  lines  of  best  fit  have  a  positive  slope 
or  increase  from  left  to  right  as  expected.  The  unique  cluster  of 
warnings  at  the  low  flight  path  angles  in  Figure  4  may  be  indicative  of  a 
nuisance  warning  problem  in  this  regime  (i.e.,  a  small  amount  of  altitude 
is  lost  with  each  warning). 
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Figure  2 
GCAS  Warnings 

Rate  of  Descent  /  Altitude  Loss 


RATE  OF  DESCENT 


Figure  4 

Ground  Clobber  Warnings 
it  Path  Angle  /  Altitude  Loss 
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Figure  5 
GCAS  Warnings 

Flight  Path  Angle  /  Altitude  Loss 
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Figure  6 
LAWS  Warnings 

Flight  Path  Angle  /  Altitude  Lcs 
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CRASH  DATA 


There  were  107  total  crashes  as  a  result  of  this  simulation  study. 
Table  S  shows  a  breakdown  of  the  crashes  by  algorithm  and  miasion. 


TAB LI  S.  CRASH  DATA 


ALGORITHM 

Ground 

Clobber 

OCRS 

LRUS 

TOTAL 


MSN  15  N8M  16  M8H  17 


6 

1  1 

16 

33 

7 

e 

23 

38 

6 

12 

18 

36 

19 

31 

57 

187 

The  crash  data  provided  no  significant  differences  between  the 
algorithms  «0.355).  The  differences  between  crashes  with  regard  to 
algorithm  type’  can  be  solely  attributed  to  chance.  There  was  a 
significant  difference  between  the  total  number  of  crashes  over  the 
missions,  explainable  in  part  by  the  different  miasion  profiles. 


The  design  of  thi?  study  allowed  for  a  direct  coiqpa-ison  between  the 
active  and  inactive  algorithms  over  all  107  crashes.  In  the  next  section, 
a  comparison  will  be  made  to  determine  how  the  off-line  algorithms  might 
have  provided  for  a  successful  pull-out.  The  analysis  was  based  at  times 
on  subjective  calls,  but  the  author's  judgement  was  conservative  at  all 
times.  In  other  words,  it  had  to  be  obvious;  given  the  airspeed,  bank 
angle,  C's,  and  flight  path  angle  at  the  time  of  an  off-line  warning,  that 
the  pilot  would  have  been  able  to  pull  out.  ThiB  evaluation  considered 
that  any  off-line  warnings  occurring  either  after  the  actual  warning  or  at 
the  same  time  would  have  also  resulted  in  a  crash.  Interpretation  was 
required  only  when  the  off-line  warnings  were  prior  to  the  on-line 
warnings  or  were  the  only  warnings.  Rationale  will  follow  the  two 
off-line  algorithm  analyses  for  each  of  the  nine  cases  (three  algorithms 
over  three  missions).  Following  the  rationale,  a  result  will  be  noted, 
identifying  the  number  of  crashes  expected  if  the  mission  were  flown  with 
that  algorithm  on-line. 


Ground  Clobber  Hiaaion  15:  Six  crashes  resulted  with  three 
warnings  provided  to  the  pilot  prior  to  impact  (Appendix  D,  part  L, 


1-6). 


plots 


22 


LAWS  Analysis:  Warnings  After  . .  1 

No  Warnings  Prior  to  Impact  .  5 


Results ;  If  the  mission  were  run  with  LAWS,  six  crashes  would  have 
resulted. 


GCAS  Analysis:  Warnings  Before  .  3 

Warnings  at  Same  Instance  .  1 

No  Warnings  Prior  to  Impact  . . .  1 

GCAS  Only  Warning. . . .  1 


In  the  instance  where  GCAS  provided  the  only  warning  (plot  2),  the  pilot 
would  not  have  had  sufficient  time  and  G  available  to  pull  out.  Of  the 
three  instances  in  which  GCAS  provided  warnings  prior  to  GC,  the  pilot 
should  have  been  able  to  recover  at  least  once  (plot  3). 


Results:  If  the  mission  were  run  with  GCAS,  five  crashes  would 

have  resulted. 


Cround  Clobber  Misaion  16:  Eleven  crashes  resulte'd.  Of  these 
eleven,  five  had  warnings  provided  to  the  pilot  prior  to  impact  (Appendix 
D,  part  2,  plots  1-11). 


LAWS  Analysis-  Warnings  Before  .  4 

Warnings  After  . . . . .  1 

No  Warnings  Prior  to  Impact  .  2 

Warned  with  Other  Off-line  Algorithm  ....  2 
LAWS  Only  Warning . . . . .  2 


In  the  four  instances  when  LAWS  warned  prior  to  GC  (plots  2,  4,  6,  and 
11),  it  appears  the  pilot  would  have  had  sufficient  warning  to  pull  out. 
The  two  cases  when  LAWS  provided  a  warning  with  Gr  \S  (plots  3  and  10) 
indicate  the  pilot  would  have  had  enough  time  to  avoid  crashing.  The  two 
oases  when  LAWS  provideo  the  only  warning  (plots  l  and  7),  the  pilot  would 
not  have  had  ample  time  to  pull  out.  In  plot  1,  the  warning  was  three 
seconds  (aec)  prior  to  impact,  but  given  the  FPA  and  bank  angle  at  the 
warning  instance,  it  would  appear  to  'oo  insufficient. 


Result:  If  the  misaion  were  run  with  LAWS,  five  crashes  would 

have  resulted. 


GCAS  Analysis:  Wai  lings  Before  . .  4 

Warnings  at  Same  Instance  .  1 

No  Warnings  Prior  to  Impact  .  2 

GCAL  Oi.iy  Warning  . .  2 


Warned  with  Other  Off-Line  Algorithm  ....  2 
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In  Che  four  instances  when  GCAS  warned  prior  to  GC  (plota  2,  4,  6,  and 
11),  the  pilot  appears  to  have  been  able  to  pull  out  in  all  cases.  The 
two  instances  when  GCAS  was  the  only  algorithm  providing  a  warning  (plots 
5  and  9),  it  also  appears  Che  pilot  could  have  avoided  a  crash.  The  two 
cases  when  GCAS  warned  off-line  with  LAWS  (plots  3  and  10),  it  appears  the 
pilot  could  have  pulled  out. 


Result :  If  the  mission  were  run  with  GCAS,  three  crashes  would 

have  resulted. 


Ground  Clobber  Miaaion  17:  Sixteen  crashes  resulted.  Of  these 
sixteon  crashes,  six  warnings  were  provided  to  the  pilot  prior  to  impact 
(Appendix  D,  part  3,  plots  1-16). 

LAWS  Analysis:  Warnings  Before  . . . .  1 

Me  Warnings  Prior  to  Impact  .  12 

Warned  With  Other  Off-line  Algorithm  ....  2 
LAWS  Only  Warning  . . . .  1 


In  the  one  instance  when  LAWS  warned  prior  to  GC  (plot  8),  it  appears  the 
pilot  would  have  been  able  to  pull  out.  In  the  two  cases  when  LAWS 
provided  a  warning  when  the  on-line  algorithm  did  not  (plots  13  and  14), 
the  pilot  could  have  pulled  out  in  one  case  (plot  14),  but  not  in  the 
other.  LAWS  provided  the  only  warning  (plot  6)  apparently  in  sufficient 
time  for  the  pilot  to  recover. 


Result:  tf  the  mission  were  run  with  LAWS,  13  crashes  would  have 

resulted. 


GCAS  Analysis:  Warnings  Before  . . . . . .  3 

Warnings  After . . . . .  2 

Ho  Warnings  Prior  to  Impact  .  5 

GCAS  Only  Wurning . . .  4 


Warned  With  Other  Off-line  Algorithm  ....  2 


In  the  three  instances  when  GCAS  warned  prior  to  GC  (plots  7,  12,  and  16), 
the  pilot  would  have  had  sufficient  time  in  two  cases  ((.lots  7  and  16)  to 
avoid  crashing.  Of  the  four  cases  when  GCAS  provided  the  only  warning 
(plots  1,  2,  4,  and  15),  it  appears  the  pilot  would  not  have  had 
sufficient  warning  to  recover  in  any  instance.  Of  the  two  cases  when  GCAS 
warned  with  LAWS  (other  off-line  algorithm),  the  pilot  could  have  pulled 
out  in  one  case. 

Result:  If  the  mission  were  flown  with  GCAS,  13  crashes  would  have 

resulted. 
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GCAS  Mission  15:  Seven  crashes  resulted.  Of  these  seven,  four 
warnings  ware  provided  to  the  pilot  prior  to  impact  (Appendix  D,  part  4, 
plots  1-7). 


LAWS  Analysis:  Warnings  Before  . . . . .  1 

Warnings  After  . . .  1 

No  Warnings  Prior  to  Impact  .  4 

LAWS  Only  Warning  . . . . .  1 


In  the  two  instances  when  LAWS  warned  prior  to  OCAS,  the  pilot  would  have 
had  sufficient  warning  to  pull  out.  In  the  case  when  LAWS  provided  the 
only  warning  prior  to  impact  (plot  3),  the  warning  would  have  been  in 
sufficient  time  to  pull  out. 


Result :  If  the  mission  had  been  flown  with  LAWS,  five  crashes 
would  have  resulted. 


OC  Analysis:  Warnings  Before  . . . .  1 

Warnings  After  . .  1 

No  Warnings  Prior  to  Impact  . .  5 


The  one  GC  warning  that  occurred  before  the  GCAS  warning  (plot  1)  would 
have  enabeled  the  pilot  to  pull  out. 


Result :  If  the  mission  had  been  flown  with  GC,  six  crashes  would 

have  resulted. 


GCA8  Miaaion  16:  Eight  crashes  in  which  seven  warnings  were 
provided  to  the  pilot  prior  to  impact  (Appendix  D,  part  5,  plots  1-8). 


LAWS  Analysis:  Warnings  Before  .  2 

Warnings  After  .  3 

No  Warnings  Prior  to  tmpact  .  2 

LAWS  Only  Warning  . 1 


In  the  two  instances  when  LAWS  provided  a  warning  before  GCAS  (plotB  l  and 
14),  it  appears  the  pilot  would  have  had  enough  time  to  recover  in  one 
case  (plot  1).  In  the  instance  when  LAWS  provided  the  only  warning  prior 
to  impact  (plot  3),  the  pilot  could  have  recovered. 


Result :  If  the  mission  had  been  flown  with  LAWS,  six  crashes  would 

have  resulted. 
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GC  Analysis:  Warning*  Before  .  6 

No  Warnings  Prior  to  Impact  . .  2 


In  the  six  cases  when  GC  warned  prior  to  GCAS  (plots  I,  2,  and  4-7),  it 
appears  Che  pilot  would  have  had  sufficient  time  to  pull  out  in  three 
cases  (plots  1,  4,  and  6).  In  one  other  instance,  a  recovery  nay  have 
been  possible,  but  would  have  been  close  given  the  flight  path  angle  and 
low  air  speed. 


Result ;  If  the  mission  had  been  flown  with  GC,  five  crashes  would 
have  resulted. 


CCA8  Mission  17;  Twenty  three  crashes  rssulted.in  which  fifteen 
warnings  were  provided  to  the  pilot  prior  to  impact  (Appendix  0,  part  6, 
plots  1-23). 


LAWS  Analysis:  Warnings  Before  < . . .  2 

Warnings  After  . . .  2 

No  Warnings  Prior  to  Impact  . .  19 


In  the  two  cases  when  LAWS  provided  a  warning  prior  to  GCAS  (plots  10  and 
21),  the  pilot  would  have  had  enough  time  to  pull  out  in  one  instance 
(plot  10),  and  insufficient  time  in  the  other. 


Result:  If  the  mission  had  been  flown  with  LAWS,  22  crashes  would 

have  been  recorded. 


GC  Analysia:  Warnings  Before  .  6 

Warnings  After  . . .  2 

Warnings  at  the  Same  Instance  . .  4 

No  Warnings  Prior  to  Impact  .  11 


Of  the  six  cases  when  GC  warned  the  pilot  before  GCAS  (plots  7,  10,  11, 
14,  15,  and  19),  the  pilot  would  have  been  able  to  pull  out  in  one  case 
(plot  11).  The  other  five  cases  would  not  have  warned  the  pilot  in 
sufficient  time. 


Result :  If  the  mission  had  been  flown  with  GC,  22  crashes  would 

have  been  recorded. 


LAW8  Miaeion  15:  Six  crashes  resulted,  with  no  warnings  to  the 
pilot  prior  to  impact  (Appendix  0,  part  7,  plots  1-6). 
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GCAS  Analysis: 


Only  Warning . .  3 

Warned  with  Other  Off-line  Algorithm  ....  3 


In  the  three  cases  when  GCAS  provided  the  only  warning  (plots  1,3,5),  the 
pilot  would  have  been  warned  in  sufficient  time  to  pull  out  in  only  one 
case  (plot  3).  In  the  three  cases  when  GCAS  warned  with  the  GC  algorithm, 
both  off-line,  the  pilot  may  have  avoided  a  crash  in  one  instance  (plot 
6).  In  this  case,  the  GCAS  warning  is  in  response  to  rising  terrain  which 
the  pilot  may  have  considered  a  nuisance.  It  is  unclear  whether  the  pilot 
would  have  changed  the  aggressive  bunt  down  the  backside  of  the  ridge.  If 
he  did  not,  he  still  would  have  crashed. 


Result:  If  the  mission  had  been  flown  with  GCAS,  five  crashes 

would  have  been  recorded. 


GC  Analysis;  No  Warnings  Prior  to  Impact  .  3 

Warned  with  Other  Off-line  Algorithm  ....  3 

Plots  1,  3,  and  5  show  GC  provided  no  warning  prior  to  impact.  Plots  2, 

4,  and  6  show  GC  did  provide  off-line  warnings  to  the  pilot  that  would  not 
have  provided  warning  in  sufficient  time  to  avoid  crashing.  In  plot  6  the 
warning  was  approximately  1.5  seconds  prior  to  impact. 


Result :  If  the  mission  had  been  flown  with  GC,  six  cranhes  would 

have  been  recorded. 


LAW8  Mission  16:  Twelve  crashes  resulted,  with  seven  warnings  to 
the  pilot  prior  to  impact  (Appendix  0,  part  8,  plots  1-12). 


GCAS  Analysis:  Warnings  Before  . . .  7 

No  Warnings  Prior  to  Impact  .  1 

Warned  with  Other  Off-line  Algorithm  ....  2 
GCAS  Only  Warning  . .  2 


The  seven  cases  where  GCAS  provided  a  warning  before  LAWS  are  shown  in 
plots  2,  4,  5,  and  8-11.  If  the  pilot  were  responding  to  a  GCAS  warning, 
it  appears  the  crashes  in  plots  2,  8,  9,  10,  and  11  could  have  been 
avoided.  The  crash  represented  by  plot  4  does  not  indicate  the  pilot 
responded  with  as  great  a  sense  of  urgency  as  required.  For  this  reason, 
the  GCAS  warning  1.2  sec  earlier  would  probably  have  resulted  in  a  crash. 
The  crash  depicted  in  plot  5  indicates  the  earlier  GCAS  warning  (approx 
0.4  sec  earlier),  was  insufficient  to  change  its  outcome.  Plots  3  and  6 
depict  the  cases  when  GCAS  provided  the  only  warnings  prior  to  impact.  It 
appears  in  both  caoes  the  pilot  would  have  been  warned  in  sufficient  time 
to  pull  out.  In  the  two  cases  when  GCAS  provided  a  warning  with  the  other 
off-line  algorithm,  it  again  appears  sufficient  warning  would  have  been 
given  to  allow  a  recovery  (Plot  7  with  5  sec  and  plot  1.2  with  a  3.25  sec 
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warning  prior  t;.  impact). 


Result :  If  the  mission  were  flcwn  with  GCAS,  three  crashes  would 

have  been  recorded. 


GC  Analysis:  Warnings  Before  . . .  5 

Warnings  After  . . .  1 

No  Warnings  Prior  to  Impact  . . .  4 


Warned  with  Other  Off-line  Algorithm  ....  2 


The  five  cases  when  the  GC  warning  came  on  before  the  LAWS  warning  (plots 
4,  5,  8,  9,  and  11),  would  have  probably  resulted  in  fewer  crashes.  The 
pilot  would  have  received  a  warning  2.5  sec  earlier  in  plot  4,  about  3.5 
sec  in  plot  5,  3.25  sec  in  plot  8,  3.5  sec  in  plot  9,  and  2.5  sec  in  plot 
11.  It  appears  the  pilot  could  have  pulLed  out  in  every  case  except  that 
depicted  in  plot  4.  The  extension  of  the  flight  path  in  plot  4  after  the 
pilot  received  the  LAWS  warning,  back  to  the  point  where  GC  came  on, 
indicates  the  pilot  would  have  crashed.  In  plots  7  and  12,  GC  provided  a 
warning  with  the  other  off-line  algorithm.  lu  both  of  these  cases,  it 
appears  the  pilot  would  not  have  had  time  to  recover.  Both  warnings  were 
approximately  1.5  -  2.0  sec  prior  to  impact. 


Results:  If  the  mission  were  flown  with  GC,  eight  crashes  would 

have  been  recorded. 


LAWS  Mission  17:  Eighteen  crashes  resulted.  Of  these  eighteen, 
five  warnings  were  provided  to  the  pilot  prior  to  impact  (Appendix  D,  part 
9,  plots  1-18), 


GCAS  Analysis:  Warnings  Before  .  3 

Warnings  After  . .  2 

No  Warnings  Prior  to  Impact  .  2 

Warned  with  Other  Off-line  Algorithm  ....  7 

GCAS  Only  Warning . 3 

Warned  at  Same  Instance  .  1 


The  three  cases  when  GCAS  provided  warnings  before  LAWS  are  shown  in  plots 
8,  9,  and  18.  In  plot  8,  the  pilot  may  have  considered  the  GCAS  alarm  a 
nuisance  and  may  not  have  responded  by  reducing  the  aggressiveness  of  his 
bunt  down  the  backside  of  the  ridge.  It  is  therefore  not  clear  if  the 
crash  would  have  been  avoided.  In  plot  9,  the  GCAS  warning  preceded  the 
LAWS  warning  by  2  sec.  This  would  have  been  insufficient,  given  the 
flight  path,  to  prevent  the  crash.  In  plot  18,  the  GCAS  warning  was  less 
than  2  sec  prior  to  LAWS  and  would  not  have  provided  time  to  pull  out.  In 
the  seven  cases  when  GCA8  provided  n  warning  along  with  the  other  off-line 
algorithm  (plots  1,  3,  5,  7,  10,  14,  and  15),  it  appears  the  pilot  could 
have  avoided  a  mishap  in  one  case  if  he  responded  to  n  GCAS  warning.  In 
plot  15,  the  pilot  was  flying  over  cough  terrain  toward  a  ridge.  GCAS 
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provided  a  warning  10  aec  prior  to  impact,  although  not  necessarily 
responding  to  the  danger  of  the  ridge  impacted.  A  crash  nonetheless  could 
have  been  avoided  if  the  pilot  had  reacted  to  the  GCAS  alarm.  However,  it 
is  unclear  if  this  would  have  been  the  case.  The  three  cases  GCAS 
provided  the  only  alarm  (plots  4,  13,  and  17),  crashes  could  have  been 
avoided  in  two  cases.  In  plot  4,  GCAS  provided  a  warning  10  sec  prior  to 
impact.  Although  the  GCAS  warning  could  be  considered  somewhat  premature, 
if  the  pilot  had  responded,  he  would  have  avoided  the  ridgn  -clip.  In  plot 
13,  the  GCAS  warning  was  2  sec  prior  to  impact,,  and  given  the  flight 
parameters,  it  appears  a  crash  could  have  been  avoided. 


Result:  If  the  mission  had  been  flown  with  GCAS,  15  crashes  would 
have  been  recorded. 


GC  Analysis:  Warnings  Before  . .  2 

Warnings  After  . .  2 

Warnings  at  Same  Instance  .  1 

GC  Only  Warning  . .  1 

Warned  with  Other  Off-line  Algorithm  ....  7 
No  Warnings  Prior  to  Impact  . .  5 


The  two  cases  when  GCAS  provided  warnings  before  LAWS  are  shown  in  plots  8 
and  16.  In  plot  8,  the  pilot  may  have  considered  the  GCA§  alarm  a 
nuisance  and  may  not  have  responded  by  reducing  the  aggressiveness  of  his 
bunt  down  the  backside  of  the  ridge.  It  is  therefore  not  clear  if  the 
crash  could  have  been  avoided.  In  plot  8,  the  GC  alarm  preceded  LAWS  by  2 
sec.  This  would  appear  to  be  insufficient  to  avoid  impact.  The  case  when 
GC  provided  the  only  warning  is  shown  in  plot  16.  This  warning  proceeded 
impact  by  leas  than  1  sec,  providing  insufficient  time  for  recovery.  The 
sever,  cesee  when  GC  provided  an  off-line  warning  with  GCAS  are  shown  in 
plots  1,  3,  5,  7,  10,  14,  and  15.  In  plot  3,  GC  provided  a  warning  10  sec 
prior  to  impact.  If  the  pilot  reacted  to  the  pull-up  warning  and  did  not 
consider  it  a  nuisance,  the  crash  would  most  likely  have  been  avoided.  It 
is  clear  in  the  other  cases  that  the  GC  warning  would  have  been 
insufficient  to  avoid  crashing. 


Result :  If  the  mission  were  flown  with  GC,  17  crashes  would  have 

been  recorded. 


The  resultant  on-line/off-line  crash  data  are  shown  in  Table  6, 


Table  6. 


OH-LIHK /OFF-LIRE  DATA 


ALGORITHM 

Ground 

Clobber 

GCAS 

LAWS 

TOTAL 


ASH  IS  NGN  16  NGN  17 


is 

24 

55 

9? 

17 

14 

51 

82 

17 

23 

53 

93 

S  2 

61 

158 

271 

Tha  crash  data  again  ravaala  no  significant  differences  batwaen  tha 
algorithms,  ragardlass  of  tha  incraasa  in  data  points , $w.  cj  1.047).  The 
large  number  of  crashes  associated  with  Mission  17,  in  comparison  with 
Missions  13  and  16,  can  be  explained  by  tha  more  aggressive  maneuvers 
required  for  this  mission.  It  would  be  difficult  to  accurately  project 
how  the  modified  GCAS  algorithm  would  have  performed.  However,  since  the 
changes  were  aimed  at  reducing  niuaance  warnings  (essentially  providing 
warnings  closer  to  the  ground),  one  would  speculate  the  number  of  clashes 
would  be  greater  when  compared  to  the  crash  performance  of  the  unmodified 
GCAS  algorithm. 


PEKFORMANCE  IN  SPECIFIED  ENVIRONMENTS 


The  crash  data  docs  not  highlight  one  algorithm  as  being  clearly 
superior  to  the  others.  The  crash  plots  will  now  bu  divided  into 
different  flight  profiles  to  determine  if  one  algorithm  is  superior  to  the 
others  in  a  specific  environment.  The  next  section  will  examine  this 
potential  over  three  profiles:  flat  earth,  descents  into  rising  terrain, 
and  level  flight  into  rising  terrain. 


FLAT  EARTH 

There  were  21  plots  identified  as  descents  into  flat  terrain.  The 
GCA3  algorithm  provided  a  warning  in  each  instance  (21/21),  with  an 
average  warning  of  5.24  sec  prior  to  impact.  The  GC  algorithm  provided 
warnings  in  17  instances  (17/21),  with  an  average  warning  of  5.31  sec. 

The  LAWS  algorithm  warned  in  16  instances  (16/21),  with  an  average  warning 
of  4,19  sec. 
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It  ia  important  to  note  that  none  of  the  21  plots  used  to  arrive  at 
the  data  were  affected  by  inputs  from  the  experimenter's  control  station. 
The  pilot  was  acting  at  his  own  control  during  all  21  cases.  In  addition, 
the  warning  frequency  cannot  be  tied  to  either  valid  or  niusance  warnings. 
Warning  frequency  does  however,  provide  input  on  the  breadth  of  coverage 
in  a  specific  environment.  The  data  indicate  GCAS  provides  warnings  under 
more  conditions  than  GC  or  LAWS  in  the  flat  earth  environment.  The  GCAS 
and  GC  algorithms  on  the  average  provided  5.24  sec  and  5.81  sec  warnings 
respectively,  considerably  more  than  the  4.19  sec  LAWS  average  warning. 
This  1.0  -  1.5  see  average  warning  time  discrepancy  can  be  attributed  in 
part  to  the  lack  of  a  G  -  limit  in  the  LAWS  algorithm.  Crash  frequency 
can  be  assessed  in  this  environment  and  ia  shown  in  Table  7. 


TABLE  7.  DIVING  INTO  FLAT  TBBBAIN 


ALGORITHM 


CROUMD 

CLOBBER 

•COB 

LOWS 


AUERAGE 

WARNING  WARNING  CRASH 
TIME  FREQ  FREQ 


S.Blm 

17/51 

a/15 

5.54* 

51/51 

10/15 

4.19s 

15/51 

14/51 

The  data  indicate  a  non-signi|icant  difference  between  the  algorithms 
with  regard  to  crash  frequency,  The  data  nonetheless  is 

indicative  of  the  philosophical  differences  between  the  algorithms. 


DKSCENTS  INTO  RISING  TERRAIN 


There  were  12  plots  identified  as  descents  into  rising  terrain.  A 
minimum  average  slope  of  six  degrees  for  the  three  second*  prior  to  impact 
was  the  criterion  used  to  define  rising  terrain.  The  GCAS  algorithm 
provided  a  warning  in  9  instances  (9/12),  with  an  average  warning  of  1.1 
sec.  The  GC  algorithm  provided  warnings  in  5  instances  (5/12),  with  an 
average  warning  of  0.76  sec.  The  LAWS  algorithm  warned  in  no  casus 
(0/12). 

2  The  data  indicate  GCAS  provides  warnings  significant,  ly  more  often, 

(,j.“  8.71  than  the  other  algorithm#  in  this  environment.  The  craah 


plots,  however,  indicate  the  additional  warnings  provided  little 
protection  against  crashes  as  indicated  in  Table  8. 

TABLE  8.  DIVING  INTO  RISING  TERRAIN 


ALGORITHM 


8R0UND 

CLOMCR 


tens 


LANS 


RVERRGE 

WARNING  WARNING  CRRSH 
TINE  FREQ  FREQ 


0.76s 

5/12 

12/12 

1.10* 

9/12 

11/12 

0.00s 

0/12 

12/12 

The  data  in  this  environment  indicate  none  of  the  three  algorithms 
provide  adequate  protection  against  descents  into  rising  terrain. 


LEVEL  FLIGHT  INTO  RISING  TERRAIN 


There  ware  24  plots  identified  as  level  flight  into  rising  terrain. 

A  minimum  average  slope  of  six  degrees  for  the  three  seconds  prior  to 
impact  was  the  criterion  used  to  define  rising  terrain.  Warnings  were 
provided  by  GCAS  in  12  instances  (12/24),  with  an  average  warning  time  of 
0.28  sec.  The  GC  algorithm  provided  five  warnings  (5/24),  with  an  average 
warning  time  of  0.27  sec.  LAWS  provided  no  warnings  in  the  24  cases.  The 
LAWS  minimum  design  altitude  of  90*  should  have  provided  warnings  whan  90* 
was  penetrated.  As  previoully  discussed,  this  would  have  provided 
insufficient  warning  to  avoid  crashing.  The  data  indicate  none  of  the 
algorithma  provide  protection  from  level  flight  (+5)  into  rising  terrain 
(Table  9). 


TABLE  9.  LEVEL  FLIGHT  INTO  RISING  TERRAIN 


RLGQRITHN 

OROUND 

CL0R0ER 


ICM 

LOUR 


RUERAGE 

WARNING  WARNING  CRASH 
TINE  FREQ  FREQ 


0.2Be 

5/24 

24/24 

0.2Be 

12/24 

24/24 

0.00e 

0/24 

24/24 

2  GCAS  provides  significantly  more  warnings  in  this  environment, 

/C  ■  12.82,  although  providing  minimal  additional  protection. 

«<*  or 
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SUBJECTIVE  DATA 


Subsequent  to  each  flight  and  at  the  end  of  the  evaluation,  pilots 
were  asked  to  rate  each  warning  system  on  a  variety  of  Pilot  Vehicle 
Interfaces  (PVI)  and  systems  operations  areas.  The  tabulated  results  of 
questionnaire  data  are  shown  in  Appendix  C. 

Asked  to  rate  timeliness  of  the  warning  systems  on  a  five  point 
scale,  a  majority  of  the  pilots  rated  the  systems  "Just  Right".  Ratings 
were:  Ground  Clobber  53%,  GCAS  5 7 X ,  and  LAWS  62.5%.  The  next  moat  often 
rated  description  for  all  systems  was  "Too  Early",  with  Ground  Clobber 
27%,  GCAS  25%,  and  LAWS  12.5%. 

When  asked  how  often  they  had  nuisance  warnings  on  a  five  point 
scale,  the  majority  chose  "Seldom"  most  often,  for  ground  clobber  and 
GCAS,  with  33.3%  and  43.7%  respectively.  "Never"  scored  highest  for  LAWS 
with  62.5%. 

Most  pilots  rated  the  attention  getting  characteristics  of  the  system 
highly.  Asked  if  the  warnings  got  their  attention,  the  rating  selected 
most  often  was  "Yea,  all  the  time",  with  73%  for  Ground  Clobber,  87.5%  for 
GCAS  and  79.2%  for  LAWS.  "Most  of  the  time"  was  the  only- other  selection 
for  all  systems. 


33 


VI.  DISCUSSION 


This  study  did  not  conclusively  identify  one  algorithm  as  being 
clearly  superior  to  the  others.  All  three,  however,  differ  in  obvious 
ways  chat  will  now  be  discussed. 


WARNING  SYSTEM  CONCEPT 

If  either  one  of  the  three  competing  systems  or  even  a  combination  of 
the  best  features  of  all  three  are  determined  to  be  necessary  in  fighter 
aircraft,  pilots  must  be  cautioned  that  the  system  will  not  protect 
against  CFIT  in  all  conditions. 

While  all  cheae  algorithms  are  relatively  straightforward  in  terms  of 
calculations  to  change  flight  path,  they  differ  in  approaches  to  limit  the 
number  of  unnecessary  or  "nuisance"  warnings.  Essentially,  they  all  try 
to  anticipate  pilot  intentions  in  a  variety  of  conditions.  For  example, 
the  three  algorithms  inhibit,  or  by  some  other  means,  eliminate  most  oe. 
the  "look  forward"  aspects  of  the  calculation  to  eliminate,  or  minimize 
unnecessary  warnings  during  ridge  or  hill  crossings  in  near  level  flight. 
As  a  conoequence,  there  is  minimal  warning  or  protection  agsirst  flight 
into  rising  terrain  when  the  aircraft  path  angle  is  less  than  five  degrees 
for  GCAS  and  GC,  and  less  than  three  degrees  for  LAWS.  Under  these 
conditions  the  LAWS  provides  a  warning  at  90  ft.  above  the  terrain,  and 
the  GCAS  at  the  set  ALOW  setting. 


PULLUP  ANTICIPATION  CUE 


The  General  Dynamics  Ground  Clobber  algorithm  is  the  only  one  of 
three  evaluated  that  provides  an  alert  cue  to  advise  the  pilot  of  an 
impending  "PULL-UP"  warning.  This  cue  is  designed  to  appear  10  seconds 

prior  to  the  lJULL-UP.  ActuaLly  it  can  appear  much  less  than  10  seconds 

prior  to  a  warning  in  Dynamic  low  level  maneuvering. 

The  anticipation  symbol  is  the  same  one  used  for  pull-up  anticipation 
in  air-to-ground  bombing  models  and  also  ae  an  arming  deLay  cue.  In  some 
cases  the  symbol  could  appear  twice  during  a  delivery,  first  as  an  arming 
delay  cue  and  then,  after  weapon  release,  as  a  pull-up  cue.  Careful 
consideration  should  be  given  to  assigning  a  third  function  to  the  same 
symbol.  This  puts  the  pilot  in  the  position  of  trying  to  determine  which 
of  three  advisory  functions  caused  the  cue  to  appear.  The  AFTI  F-16  has 

an  anticipation  function  that  uses  two  halves  of  the  Break  "X"  cue  that 

acpeac  separated  at  the  anticipation  cue  and  r.;ove  laterally  to  form  the 
Break  "X"  at  the  pullup  warning.  This  may  be  an  option. 
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Another  potential  problem  in  this  mecnanization  was  that  the 
anticipation  cue  had  to  be  9een  to  provide  any  useful  information  to  the 
pilot.  Aa  such,  if  he  was  preoccupied  with  cockpit  systems  operation, 
attempting  to  locate  another  flight  member,  or  checking  six,  the  cue  was 
useless.  If  appearance  of  the  cue  was  accompanied  by  a  tone  or  some  other 
audible  alert,  its  utility  could  be  expanded  through  the  rest  of  the 
algorithm's  useful  flight  envelope. 


SELECTABLE  GROUND  CLEARANCE  SETTING 


The  GCAS  was  the  only  one  of  Che  three  algorithms  that  included  a 
pilot  selectable  minimum  altitude.  (LAWS  is  set  at  90  feet,  GC  at  50 
feet).  For  this  evaluation,  the  GCAS  ALOW  setting  was  constant  at  90  feet 
to  provide  consistent  and  comparable  data,  however,  the  added  flexability 
is  considered  a  strength. 

Altitude  warning  systems  such  aa  those  used  in  this  evaluation  are 
primarily  for  peacetime  training  environments.  It  is  highly  unlikely  that 
a  pilot  would  have  emitters  such  aa  the  radar  altimeter  operating  in  a 
threat  environment;  hence,  no  warning  system.  However,  since  different 
categories  of  tactical  pilots  have  different  minimum!  in  the  low  level 
training  environment,  the  ability  to  select  more,  or  less,  protection  in 
terms  of  warning  height  can  be  a  distinct  advantage.  One  thing  that  must 
be  considered  in  an  F-16  integration  is  the  establishment  of  some  minimum 
default  value  for  the  warning  system.  In  this  test,  the  ALOW  feature  In 
the  F-16  cockpit  was  used  to  establish  the  GCAS  clearance  buffer. 
Currently,  ALOW  defaults  to  zero  with  aircraft  electrical  power  cycles; 
this  would  have  to  be  changed  to  some  agreed  upon  value  such  as  100  feet 
with  the  same  ">ilot  selectable  option  to  set  the  minimum  higher  or  lower 
at  his  discretion. 


EARLY  WARNINGS 


One  potential  problem  noted  with  the  Ground  Clobber  and  earlier  GCAS 
algorithms  were  pilot  reports  of  early  warnings  during  dive  recoveries. 
This  was  especially  true  at  the  higher  dive  angles  experienced  during  the 
weapons  delivery  maneuvers.  As  long  aa  dive  angles  were  limited  to  20-25 
degrees,  pilots  were  able  to  complete  the  deliveries  without  a  pull-up 
warning.  When  dive  angles  increased  to  30  degrees  or  more,  warnings 
frequently  occurred  up  to  10C0  feet  or  more  above  the  briefed  release 
altitude,  while  pilots  were  making  flight  path  corrections  on  the  delivery 
runs.  These  were  normally  reported  as  early  warnings  and,  because  they 
were  obviously  early,  nilots  merely  flew  through  the  warning  and  completed 
the  delivery.  The  obvious  problem  here,  of  course,  is  that  with  more 
experience  with  the  system,  pilots  will  ignore  warnings  when  they  think 
they  are  in  a  situation  that  might  lead  to  early  activation. 


■v  - 
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It  was  somewhat  surprising  chat  evaluation  pilots  were  as  tolerant  as 
they  were  with  what  has  been  referred  to  as  "nuisance  warnings".  Probably 
the  primary  reason  for  this  is  that  they  understood  the  limitations  of  a 
look-down  radar  altimeter  as  a  device  to  "see"  what  is  ahead  of  the 
aircraft.  During  the  evaluation  flights  and  in  de-briefing,  they  seemed 
less  tolerant  of  the  lack  of  warnings  in  near  level  flight,  when  flying 
into  rising  terrain,  and  in  steep  bank  (hard)  turns  exceeding  the  roll 
limits  of  the  CARA. 


RECOMMENDATIONS  FOR  FUTURE  STUDIES 


The  initial  focus  of  this  report  was  to  test  the  Ground  Clobber 
Algorithm  over  a  variety  of  flight  scenarios.  The  study  was  therefore 
designed  Co  test  the  algorithm  over  different  terrain  profiles  with  the 
man-in-the-loop.  This  design  introduced  a  fair  amount  of  subject 
variability  and  made  it  difficult  to  clearly  ascertain  if  one  of  the  three 
algorithms  tested  was  superior  to  Che  others.  A  study  to  test  the 
differences  or  similarities  and  advantages  or  disadvantages  of  each 
algorithm  can  be  more  easily  assessed  in  a  controlled  laboratory 
environment.  Flying  the  algorithms  against  specific  profiles  with  only 
one  subject  pilot  providing  input  would  provide  clean,  comparative  data. 
The  profiles  may  include  varying  degrees  of  dive  into  rising  terrain  and 
level  terrain.  The  profiles  can  he  further  characterised' by  varying  bank 
angle  and  air  speed. 


CURRENT  ALGORITHM  CONFIGURATIONS 

The  algorithms  evaluated  in  this  study  were  current  through  November, 
1986.  (A  more  current  version  of  GCAS  dated  January,  1987  was  also 
addressed  in  the  report).  Because  these  algorithms  are  continually 
subjected  to  modifications,  the  reader  is  provided  information  to  attain 
the  most  up-to-date  algorithm  configuration. 


GCAS 
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GC  . . .  Capt  Bruce  Pete 

ASD/YPEF 
AV  785-6605 
Comm  255-6605 


LAWS  . .  Ms.  Diane  Shah 

ASD/ENFTC 
AV  785-5563 
Con»n  255-5563 


36 


VII.  COMCLOS IONS 


1.  AIL  three  systems  tested  will  provide  warnings  in  sufficient  time  to 
recover  in  some  CFIT  situations. 


2.  All  three  systems  provide  little  or  no  protection  in  near  level  flight 
into  rising  terrain  conditions. 


3.  Similarly,  protection  against  CFIT  in  shallow  descants/climbs  is 
marginal. 

4.  None  of  the  systems  tested  provide  a  complete  solution  to  the  CFIT 
problem. 


5.  For  all  practical  purposes,  all  three  systems  are  of  little  or  no  use 
in  aircraft  attitudes  outside  CARA  limits  of  plus  or  minus  45  degrees  of 
pitch  and  plus  or  minus  60  degrees  of  roll. 

6.  Ground  Clobber  warning  and  recovery  altitudes  are  significantly  higher 
chan  either  LAWS  or  the  latest  GCAS. 


7.  Pilots  generally  liked  the  Ground  Clobber  prediction  cue  concept, 
however,  the  symbol  should  receive  further  evaluation,  and  an  audible  tone 
should  be  considered.  Additional  guidance  for  tone  usage  can  be  found  in 
MIL-STD- 1800 ,  Human  Engineering  Performance  Requirements  for  Systems  (4.6 
Audio  Signals). 


8.  The  selectable  warning  altitude  feature  in  the  GCAS  is  a  plus, 
especially  in  a  peacetime/training  environment  where  the  system(s)  will  be 
avai lable. 


9.  Under  moat  conditions,  recoveries  from  LAWS  warnings  will  lea  *  to 
exceeding  F-16  stores  "G"  limits. 

10.  Of  the  three  systems,  only  GCAS  provides  protection  in  over-the-top 
maneuvers,  and  it  will  do  this  only  under  limited  entry  conditions. 
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APPENDIX  A 


GC  ALGORITHM  MECHANIZATION 

The  Ground  Collision  algorithm  uaed  in  Chi*  evaluation  is  commonly 
referred  to  a*  Che  Operational  Capabilities  Upgrade  (OCU)  version. 

Another  Enhanced  Ground  Clobber  modification  of  the  algorithm  was  also 
flown  by  each  participating  pilot  on  one  mission  during  eh*  evaluation. 
Both  algoriehms  will  be  discussed  in  Che  following  paragraphs. 

OCU  Ground  Clobber 

The  basic  OCU  algorithm  is  an  ext  .jion  of  the  original  P-16  A/B 
Ground  Clobber  system  that  uses  either  Air  to  Ground  Rang*  (AGR)  data  or 
system  altitude/targct  altitude  values.  The  primary  source  of  data  for 
the  OCU  algorithm  is  the  CARA  system  with  backup  capabilities  similar  to 
the  A/B  system  in  the  event  of  loss  of  valid  CARA  data. 

The  algorithm  continuously  compares  aircraft  height  above  the  ground 
with  the  altitude  required  for  dive  recovery.  It  predicts  altitude  loss 
during  dive  recovery  as  a  sum  of  Che  following: 

a.  Altitude  loss  due  to  pilot  response  time. 

b.  Altitude  loss  during  roll  recovery. 

c.  Altitude  loss  during  a  4-C  pullup. 

A  50  foot  buffer  is  resident  in  the  system  so  that  if  the  aircraft  is 
flown  exactly  in  accordance  with  the  algorithm  assumptions!  recoveries 
will  be  consisted  at  50  feet  AGL  ♦  10Z  of  the  altitude  lost  during  the 
pullup.  Figure  7  shows  basic  system  operation. 


Figure  7,  OCU  Ground  Clobber  Mechanisation 


The  following  values  are  used  in  calculating  altitude  loss  in  the 
recovery  procedure. 

a.  Pilot  response  time.  The  algorithm  assumes  that  the  pilot  will 
react  to  e  warning  in  1.0  second.  The  value  is  consistent  with  recorded 
pilot  response  times  in  the  1986  GCAS  evaluation:  (0.8  sec). 

b.  Altitude  lose  during  roll  recovery.  The  time  value  for  roll 
recovery  varies  with  bank  angle  aa  shown  in  Figure  8.  Note  that  at  bank 
angles  of  leas  than  30  degrees,  no  time  is  allowed  for  rolling  to  wings 
level.  At  bank  angles  in  exces  i  of  30  degrees,  time  allowed  varies 
linearly  to  a  maximum  of  3.0  aa jonds  if  the  aircraft  is  inverted. 


c.  Altitude  loss  during  a  4-G  pull  up.  One  second  iB  added  to  the 
altitude  loss  calculations  to  account  for  the  time  it  takes  to  transition 
from  1  to  4  G  flight. 

Additional  buffers  are  included  in  the  system  to  handle  operation  in 
the  lw  speed  regime  where  4  Gs  are  not  available.  The  mechanization 
breaks  operations  into  three  ranges;  less  chan  330  knots  where  the  buffer 
is  increased  to  13  percent  of  projected  altitude  loss,  330-380  knots  where 
it  decreases  linearly  from  15  to  102,  and  speeds  above  380  knots  where  it 
is  held  constant  at  102. 

The  combined  effects  of  the  timing  factors  and  buffers  described 
above  are  realistic  only  if  the  pilot  accomplishes  the  recovery  in  a 
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step-by-step  manner.  If,  on  the  other  hand,  conditions  for  a  warning  are 
met  during  a  routine  rolling  recovery  maneuver,  pilot  response  time  is 
essentially  zero,  roll  to  wings  level  time  is  negligible,  and  time  to  A  Gs 
may  be  zero.  In  this  situation  the  recovery  will  be  completed  at  an 
abnormally  high  altitude  and  the  pilot  will  report  a  high  or  earlier  than 
desired  warning. 

The  algorithm  is  designed  primarily  as  a  dive  recovery  system.  In 
fact  early  Ground  Clobber  mechanization  was  optimized  for  a  30  degree  dive 
recovery.  As  a  consequence,  there  is  no  real  protection  against  level 
flight  into  rising  terrain. 

The  Ground  Clobber  system  assumes  a  flat  earth  in  that  it  uses  real 
time  CARA  inputs  without  calculating  or  projecting  terrain  slope.  There 
is  also  an  inhibit  in  the  system  that  reduces  times  for  altitude  loss  due 
to  pilot  response  time,  roll  recovery  and  attaining  4  Gs  AGL  when  he  flies 
toward  rising  terrain;  or  when  climb  angle  is  less  than  -*-3  degrees  of 
level  flight.  As  a  consequence,  the  pilot  receives  a  warning  at  50'  AGL 
when  he  descends  toward  level  terrain,  or  when  climb  angle  is  less  +3 
degrees  and  he  encounters  terrain  rising  at  a  greater  angle.  More  often 
than  not,  this  last  minute  warning  comes  too  late  to  even  initiate  a 
pull-up  to  avoid  the  terrain. 


GCAS  ALGORITHM  MBCHAHIZATIOH 


The  GCAS  algorithm  wee  analysed  by  CSDF  in  order  to  determine  the 
validity  of  warnings  in  various  flight  conditions.  For  the  purpose  of 
this  evaluation,  an  invalid  warning  is  one  which  occurs  too  early  (a 
"nuisance"  warning),  or  one  which  occurs  too  late  for  a  safe  recovery. 

The  algorithm  is  briefly  explained  here  in  order  to  provide  a  background 
for  the  analysis.  Cubic's  algorithm  continuously  compares  the  air  waft's 
present  height  above  the  ground  with  th>*  altitude  required  for  dive 
recovery.  The  algorithm  predict  altitude  lose  during  dive  recovery  as  a 
sum  of  the  following: 

e.  Altitude  loss  due  to  :arrain  rise  during  the  pull-up. 

b.  Altitude  lose  due  to  pilot  response  time. 

c.  Altitude  loss  during  roll  recovery. 

d.  Altitude  loss  during  a  5-G  pull-up. 


Figure  9  illustrates  this  piecewise  calculation  of  altitude  loss. 


Figure  9.  Piecewise  Calculation  of  Altitude  Lots 
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The  following  paragraphs  describe  each  portion  of  the  altitude  loss 
calculation  in  detail.  Reasons  for  early  or  late  warnings  are  also 
disoussed. 

a.  Altitude  loss-pilot  response 

The  initial  portion  of  the  altitude  loss  is  fairly  simple  to 
compute.  During  the  period  of  time  before  the  pilot  has  made  any 
response  to  a  warning,  the  aircraft  ia  projected  to  continue  ita  present 
vertical  trajectory.  The  current  vertical  velocity  is  multiplied  by  a 
computed  response  time  (T^  )  to  calculate  altitude  that  would  be  lost 

from  warning  to  initial  atick  input. 


b.  Altituda  Lots  During  Roll  Recovery 

The  GCAS  algorithm  predicts  the  altitude  chat  will  be  lost  while 
the  pilot  rolls  wings  level.  This  calculation  is  based  on  the  assumption 
that  the  pilot  will  not  begin  his  dive  recovery  until  he  has  brought  his 
wings  nearly  level.  The  calculation  it  made  in  the  following  manner: 

(1)  The  time  for  roil  recovery  ia  calculated.  ' 

T  -  I  0  I-  20  * 
rr  2)  prod 


Whera  0  •  roll  angle 
» 

i^pred  •  predicted  roll  rate 

-  70  ’  /See  for  20  *  <  0  <  85  * 

56  0  /Sec  for  85  ”  <  0  <145  " 

90  *  /Sec  for  145  *<  0  <180  0 


(2)  The  vertical  velocity  is  extrapolated 


V  ■  V  +  A  •  T 
rr  z  z  rr 

’•’nere 

V  ■  Extrapolated  vertical  velocity 
rr 

V  ■  Inatantaneoua  (measured)  vertical  velocity 
z 

A  *  Inatantaneoua  (measured)  vertical 
acceleration 

(3)  The  flight  path  angle  is  extrapolated: 
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■  M 

1 

'"I'i 


t  rr“  tan 


-1 


Where  ■  Instantaneous  horizontal  velocity 

(4)  The  altitude  loss  due  to  roll  recovery  is  calculated. 

A  Z  ■  V  *  T 
rr  z  rr 


or 


If  the  altitude  loss  is  legative  (i.e.  a  climb),  the  absolute 
valua|4Z  |,  is  used. 

If  the  extrapolated  flight  path  (Y  )  is  greater  than  zero 


If  the  absolute  value  of  the  roll  rate  is  greater  than 
80  *  /Sec, 


then  A  is  set  to  zero. 

c.  Altitude  Loss  During  Dive  Recovery 

The  algorithm  calculates  the  altitude  loss  that  would  occur 
during  a  wings  level,  constant  G  dive  recovery  in  the  following  manner: 

(l)  The  basic  equation  for  a  constant  G  constant  true  airspeed  dive 
recovery  is: 


A  z 


pu 


r  1 

2 

V 

In 

8 

L 

1 


n  -  cos 


ext  i 


n  ••  l 


Where  A  Z^u  ■  the  altitude  lost  during  the  pullup 


V  *  aircraft  true  airspeed  (ft/sac) 
n  *  G  available  (max  of  5) 

Yux(;  ■  extrapolated  flight  path  angle 
g  ■  32.2  ft/sec  2 

This  equation  ie  based  on  Che  assumpCion  that  dive 
recovury  is  complete  when  Y  ■  0*. 

d.  Altitude  loss  due  to  terrain  rise 


The  algorithm  calculates  the  altitude  loss  due  to  ground  rise 
using  a  filtered  estimation  of  the  terrain  slope  directly  below  the  air 
craft.  To  estimate  the  change  in  terrain  height  during  recovery,  the 
slope  is  extrapolated  for  a  time  T  ^which  is  calculated  as  a  function 
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of  initial  flight  path  angle.  The  formula  for  T  ia: 

T  ■  2V  tan  ^  J(n^  ♦  1)  tan 

gr  .  . __2 - 

— n - 

g  J  n  >  1  n-1 


where: 

T  *  time  used  to  calculate  ground  rise 

gr 

V  ■  aircraft  velocity  (ft/sec) 
g  *  32.2  ft/sec 
n  ■  4  (G's) 

^  ■  aircraft  flight  path  angle 

Once  has  been  determined,  the  following  checks  are  made  to 
determine  whether  or  not  to  calculate  ground  rise. 


1.  Calculate  T. 

impact 


T. 

impact 


_  Hei ght 

V  (terrain)  -  V  (aircraft) 

Z  l 


where  T 


impact 


Haight 


■  the  time  it  will  take  Che  aircraft  to 

hit  the  terrain  based  on  its  current  vertical 

velocity  (V  ,  .  ,...)and  the  current  rate  of 

ivaircraft) 

ground  ri« 

•  current  height  above  terrain 

If  T.  _  <  T  .  ground  riae  is  not  calculated, 
impact  reap  ® 

(  T _ ■  pilot  responses  time,  2  seconds.) 


reap 

2.  Calculate  lower  boundary  for  T. 


BOUND,  ■  T 
lwr  gr 


impact 
T, 


impact 

3.  Calculate  upper  boundary  for  T  impact 


BOUND 


upr 


T  >10  Seconds 

gr 


4.  If  T,  _  falls  between  Bound.  and  Bound  ,  ground  riae 
impact  lwr  upr 


impa 
is  calculated: 


Ground  rise  (Az^)  is  simply  calculated  as: 

^ Zgr  (terrain ) )  ^Tgr  ) 
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LAWS  ALGORITHM  ANALTSI8 


The  Fairchild  LAWS  Algorithm  continuously  compares  the  aircraft's 
present  height  above  the  ground  with  the  altitude  required  for  recovery. 
The  algorithm  inputs,  predictive  warning  mechanization,  and  inhibits  are 
discussed  below. 

INPUTS:  Inputs  to  the  LAWS  algorithm  are  as  follows:  inertial 
velocities  (Vx,  V y,  Vt),  pitch  and  bank  angles  (theta,  phi),  and  an  "inop" 
signal  from  the  Inertial  Navigation  System  (INS);  calibrated  airspeed 
(Vc),  mach  (M),  and  an  "inop"  signal  from  the  Central  Air  Data  Computer 
(CADC);  filtered  signals  of  Vc,  radar  altitude  (Hr),  and  rata  of  change 
of  Vc  and  radar  altitude  from  a  low-pass  (alpha-beta)  filter.  The  filtar 
receives  inputs  from  the  INS  and  radar  altimeter,  creates  rate 
information,  performs  extrapolation  logic  and  outputs  signals  to  the 
"inop"  lights. 

OUTPUTS:  Outputs  from  the  algorithm  are  a  LAWS  "inop"  signal  and  a 
warning  cue  which  activates  the  voice  box.  The  "inop"  signal  denotes  the 
radar  altitude  has  broken  lock  for  more  than  one  second  while  inside  thu 
radar  map. 

WANNING  COMPUTATION:  The  warning  algorithm  consists  of  two  parts;  a 
predictive  warning  calculation  and  a  minimum  dealgn  altitude  (MDA )  warning 
calculation.  There  ere  two  types  of  inhibits:  those  which  block  a 
predictive  warning  and  those  which  block  all  warnings. 

PEN8I8TINCE:  The  predictive  warning  must  persist  for  0.46  seconds  (23 
frames  for  a  50  He  operation)  to  activate  the  warning  signal  to  the  pilot. 
The  MDA  warning  must  persist  0.06  seconds  (3  frames)  before  a  warning  is 
issued.  There  is  an  added  0.14  second  delay  in  the  activation  of  the 
voice  signal. 

MINIMUM  DESIGN  ALTITUDE:  The  MDA  warning  is  issued  when  the  aircraft 
descends  below  90  feet  AGL  (the  altitude  that  the  aircraft  should  never 
penetrate ). 

PREDICTIVE  WARNING:  The  predictive  portion  of  the  algorithm  issues  a 
warning  based  on  a  prediction  of  the  time  necessary  for  recovery  based  on 
pilot  reaction  time,  flight  path  angle,  MDA,  bank  angle,  airspeed,  and 
terrain  alope.  The  predictive  part  issues  a  warning  if  the  sum  of  the 
following  predictive  factors  is  greater  than  the  radar  altitude. 


i.  HD  m  dynamic  altitude  effect  (This  accounts  for  altitude  lost 
until  pilot  reacts,  includes  a  bank  angle  factor,  and  includes  an 
empirical  determination  for  g-onset.). 

li.  HBD  ■  dynamic  biases  (This  accounts  for  MDA,  bank  angle,  flight 
path  angle,  airspeed,  and  contains  a  mach  correction  factor.  This  factor 
contains  many  empirically  chosen  correction  factors.). 
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iii.  HM  *  Jive  recovery  factor  (This  calculates  recovery  arc  to  get  to 
flight  path  parallel  to  terrain  and  is  a  simplistic  calculation  based  on  a 
constant  g,  constant  velocity,  dive  recovery.). 

iv.  HT  ■  terrain  extrapolation  equation  (Thia  accounts  for  terrain 
growth  baaed  on  slope  of  terrain  and  ia  a  hybrid  of  both  roiling  and 
diving  type  of  maneuvers  to  arrive  at  predicted  horizontal  travel  across 
terrain  during  recovery.). 

PREDICTIVE  WARMING  INHIBITS:  A  predictive  warning  is  inhibited  if  any 

of  the  following  conditions  are  true: 

i.  The  dive  angle  is  shallow  (less  than  five  degrees  down)  and 
aircraft  bank  angle  is  outside  of  the  75  to  110  degree  region.  This  ridge 
clip  inhibit  ia  based  on  the  fact  that  a  90  foot  roll  call  would  give  the 
pilot  approximately  two  seconds  to  recover.  The  pilot  is  aituationally 
aware  unless  ha  is  in  the  high  bank  region  in  which  case  he  will  get 
approximately  300  feet  of  altitude  at  the  warning.  In  addition,  there  is 
a  high  improbability  of  CFIT  for  this  circumstance. 

ii.  The  slope  of  terrain  ia  steep.  History  shows  a  chance  of  a  CFIT 
for  steep  terrain  is  small. 

iii.  The  rate  of  closure  is  not  excessive  (less  than  200  feet/second 
down),  and  \jpward  acceleration  is  sufficiently  positive  (at  least  10 
feet/second  ),  indicating  the  pilot  has  already  initiated  a  recovery. 

iv.  The  rate  of  closure  is  small  (less  than  10%  of  total  velocity). 
When  the  difference  betwaen  the  flight  path  angle  and  ground  slope  is 
approximately  six  degrees  or  less,  the  closure  rate  is  slow  enough  to 
preclude  a  predictive  warning. 

v.  The  aircraft  is  in  a  bunt  maneuver  (load  factor  0.5  "G",  dive 
angle  15  degrees,  and  banx  angle  30  degrees).  This  type  of  maneuver 
occurs  only  as  a  result  of  deliberate  pilot  action.  Since  the  warning 
system  is  based  on  Visual  Flight  Reference  (VFR),  and  CFITs  occur  when  the 
pilot  has  lost  track  of  his  air-to-ground  relationship,  a  warning  would 
likely  be  a  "nuisance"  call  for  this  instance. 

vi.  The  velocity  is  lees  than  150  knots.  Slow  speeds  like  this 
typically  occur  only  during  landing. 

TARE-OFF  AND  LANDING:  For  take-off,  LAWS  ia  activated  after  the  gear 
is  up  and  the  altitude  ascends  past  115  feet.  This  same  logic  follows  for 
a  go-around.  Landing  is  handled  by  blocking  the  warning  when  the  gear  is 
down  and  the  altitude  is  less  than  1500  feet. 
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APPENDIX  B 


MI3S10N  IS 

LOW  LEVEL  NAV/POP-UP  DELIVERIES 


OBJECTIVE:  Evaluate  the  GCAS  ef fectiveue-s  during  low  altitude  tactical 
navigat ion/weapons  delivery. 


SCENARIO:  This  is  a  combined  nav/weapons  delivery  profile.  There  are 
three  targets  planned  for  straight  ahead  pop-up  deliveries. 
The  targets  are  fairly  easy  to  see:  a  bridge,  a  ship,  and 
an  airfield.  The  area  is  heavily  defended.  If  you  climb 
above  800  feet  AGL,  you  will  get  a  "SAM"  warning. 


START: 


A  l.titude : 
Airspeed: 
Heading: 
Weapons : 


2100  feet  MSL  (500  feet  AGL) 
480  knots 
054  Degrees 

6  Mk  82's/Pairs/RP  1/CCTP 


INSTRUCTIONS: 


1.  Fly  480  knots  Groundspeed  or  the  speed  required  to  moke 
your  TOT.  Turns  are  60  degrees  bank.  Stay  at  300  AGL 
except  during  weapons  delivery.  Maintain  480  feet 
during  target  run  on. 

2.  Weapons  Delivery: 


TGT 

1  (Bridge) 

2  (Ship) 

3  (Airport ) 


Pull-Up 

30  degrees  at  20  sec 
30  degrees  at  20  sec 
30  degrees  at  20  set 


Pull -Down 
4100  feet 
4000  feet 
4000  feet 


Release? 
2600  feet 
2500  feet 
2500  feet 


3.  If  you  get  a  pull-up  warning,  recover  and  continue  the 
mission  at  the  planned  altitude. 

4.  If  you  get  a  warning  during  NAV  leg,  evaluate  it  as 
either: 


A. 

Valid 

B. 

Inva  lid , 

expected 

C. 

Invalid, 

unexpected 
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MISSION  16 
IMC  MAMEUVEBIHC 


OBJECTIVE:  Evaluate  the  system's  ef fectivenea i  in  recovering  from 
situations  where  spatial  disorientation  is  a  factor. 


SCENARIO:  You  will  perform  a  number  of  aerobatic  maneuvers  in  IMC. 

NOTE:  A  non-standard  HUD  Bank  display  will  be  ucec  to  help  your 

attitude  awareness. 


INSTRUCTIONS 

1.  Stay  within  10  nmi  of  steerpoint  "1".  Try  to  work  back  and 
f  or  :h  between  STPT  1  and  2. 

2.  Perform  the  following  maneuvers: 


A/S 

ALT  (feet) 

Gu 

POWER 

Split  S 

300 

8000 

Ga  and  power  as  required  to 
maintain  300  knots. 

Loop 

500 

3000 

5 

MIL 

Cuban  8 

500 

3000 

5 

MIL 

S  liceback 

350 

8000 

3-5 

MIL 

Double 

Split  S 

J00 

14000 

Ga  and  power  as  required  to 
maintain  300  knots. 

3.  If  you  get  a  pull-up  warning,  complete  the  recovery  to 
a  safe  altitude  above  5000  feet  and  9et  up  for  the  next 
maneuver. 
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MISSION  17 

RANGE  MISSION  AMD  LOW  LEVEL  DEFENSIVE  TURNS 


OBJECTIVE:  Evaluate  the  algorithm*  during  a  complex  range  mission 
and  during  hard,  low  level,  defensive  turns. 

SCENARIO:  This  is  your  first  trip  to  the  Berrysburg  Bombing  Range. 

You  are  trying  out  a  number  of  alternate  run-ins  for  straight 
ahead  pop-up  deliveries.  Because  of  a  peculiar  local  airspace 
restriction,  you  must  remain  at  or  below  500  AGL  except  in  the 
target  area.  Following  the  third  delivery  pass,  proceed  direct 
to  Steerpoint  11  where  you  will  practice  hard  defensive  turns 
at  lew  altitude.  You  will  fly  a  figure  8  pattern  between 
Millersburg  and  Elizabethville.  To  keep  you  honest,  a  "SAM" 
threat  warning  will  sound  each  time  you  go  above  800*  AGL. 


START : 


Altitude : 
Airspeed: 
Heading: 
Weapons: 


1800'  MSL 
480  knots 
199  degrees 

4  MK  82 's,  stna  3  and  7, 
CCIP/Singleo  RP  -  1 


INSTRUCTIONS: 

1.  Make  3  straight  ahead  pop-up  attacks  on  the  Berryaburg 
target . 

2.  The  sequence  of  the  runs  is  on  your  map.  After  each  run, 
fly  to  the  bend  in  the  river  and  then  along  Hoof  lander 
Mountain. 

3.  If  you  are  in  doubt,  follow  the  steerpointa .  Console 
operator  will  help. 

4.  Make  tight  turns  (at  least  3  Gs). 

5.  Start  you--  pull-up  when  you  are  20  seconds  from  target. 

-  pull  up  30  degrees. 

-  pull  down  at  4000'  MSL  (30  degrees). 

-  release  at  2500'  MSL. 

-  do  your  beat  not  to  abort  the  pass  —  even  if  you  Eeel  a 
bit  steep  (unless  you  get  a  pull-up  warning). 
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6.  Stay  in  NAV  Master  Mode  until  you  are  on  run-in  heading, 
then  select  A/G. 

7.  You  will  be  asked  to  perform  additional  tasks  during  the 
mission, 

8.  If  you  get  a  pull-up  warning,  recover  and  continue  the 
mission. 

9.  After  the  last  delivery  run,  proceed  direct  to  steerpoint 
1L,  480  KCAS  at  low  level  to  establish  the  figure  8 
pattern, 

10.  At  each  steerpoint,  make  a  hard  (5-G)  turn  back  toward  the 
next  steerpoint. 

11.  Always  turn  toward  the  north,  away  from  the  mountains. 

12.  Each  time  you  turn,  you  will  be  instructed  to  read  a 
series  of  numbers  and  letters  from  a  card  located  above 
your  head  to  simulate  checking  6.  Try  to  maintain  your 
G-load  and  altitude  while  you  read  the  data. 

13.  If  you  get  a  warning,  recover  and  continue. 
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APPENDIX 


GROUND  COLLISION  AVOIDANCE  SYSTEM  PILOT  QUESTIONNAIRE 

INSTRUCTIONS:  The  purpose  of  this  questionnaire  is  to  obtain  information 
from  you  about  your  previous  flying  experience.  Your  answers  to  these 
questions  will  help  us  in  our  evaluation  of  this  simulation.  Your  honest 
opinions  are,  therefore,  essential  and  will  be  kept  confidential. 

If  you  have  any  questions,  please  ask  the  questionnaire  administrator  for 
assistance.  Take  as  much  time  as  necessary  to  answer  the  questionnaire. 

PERSONAL  DATA: 

Name  (last,  first,  rai): 

Rank:  _ 

Duty  AFSC:  ____________________________________________ 

Organization  and  Symbol: 

Duty  Station:  ' 

Duty  Phone:  _ . _ _ 

Wing  Conmander,  Squadron  Commander,  DO:  ______________________ 

Aero  Rating:  ________________________________________________ 

Ago:  _ 

Height: _ ___ 

Weight:  _ 

Vision,  Corrected:  Uncorrected: _ _ 

Years  in  Military  Service: _ _ _ 

What  type(a)  of  aircraft  have  you  flown?  (List) 

Aircraft:  _ _ 

Fighter  hours: 

F  —  1 6  Hours: 

Hours  Flying  with  Radar  Altimeter:  _ _ 

Total  Flight  Time  (Include  Student  Hours):  _ 
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GCAS  DAILY  8CUKDULE  -  1 


DAY  l  (Monday) 


0800  -  0830 

Welcome  and  simulation  overview 

0830  -  0900 

Faci lity /simulator  tour 

0910.  -  1000 

Systems  and  mission  brief 

1010  -  1100 

Cockpit  familiarization 

1110  -  1200 

Fly  familiarization 

1200  -  1300 

BREAK 

1300  -  1500 

Data  collection  flights 

Day  2  (Tuesday) 

0800  -  1200  Data  collact-ion  flights 

1300  -  1700  Data  collection  flights 

DAY  3  (Wednesday  morning) 

0800  -  1100  Data  collection  (as  required) 

1100  -  1200  Debrief  and  questionnaire 


*  Pilot  #1  will 
Pilot  n  will 
Pilot  #1  will 
Pilot  #2  will 

**  3  data  session 


fly  two  missions 
fly  two  missions 
fly  two  missions 
fly  two  missions 

s  ■  12  sorties 


the  firBt  hour, 
the  second  hour, 
the  third  hour, 
the  fourth  hour. 
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GCAS  DAILT  SCHEDULE  -  2 


DAY  1  (Wednesday 
1300  -  1330 
1330  -  1400 
1410  -  1500 
1510  -  1600 
1610  -  1700 


afternoon ) 

Welcome  and  simulation  overview 
Facility/simulator  tour 
Systems  and  mission  brief 
Cockpit  familiarisation 
Fly  familiarization 


DAY  2  (Thursday) 

0800  -  1200  Data  collection  flights 

1300  -  1700  Data  collection  flights 


DAY  3  (Friday) 
0800  -  1200 
1300  -  1600 
1600  -  1700 


Data  collection  flights 

Data  collection  flights  (as  required) 

Debrief  and  questionnaire 


*  Pilot  #1  will  fly  two  missions  the  first  hour. 

Pilot  #2  will  fly  two  missions  the  oecond  hour. 

Pilot  01  will  fly  two  missions  Che  third  hour. 

Pilot  02  will  fly  two  missions  the  fourth  hour. 


**  3  data  sessions  •  12  sorties 
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PILOT  QUESTIONNAIRE  DATA 


It  Do  you  feel  the  "Pull-nip"  warning  alarm*  were  initiated  for  the  moat 

pare: 


GROUND  CLOBBER  GCAS  LAWS  ENHANCED  GC 


TOO  EARLY 

.4/15 

27. OX 

4/16 

25.0% 

2/16 

12.  SX 

0/8 

O.OX 

SLIGHTLY  EARLY 

1/15 

6.7% 

1/16 

6. OX 

1/16 

6.5X 

2/8 

25. OX 

JUST  RIGHT 

8/15 

53. OX 

9/16 

57.  OX 

10/16 

62. 5% 

4/8 

50.  OX 

SLIGHTLY  LATE 

0/15 

o.ox 

1/16 

6. OX 

1/16 

6.25X 

1/8 

12. 5X 

TOO  LATE 

2/15 

13. 3X 

1/16 

6. OX 

2/16 

12. 5X 

1/8 

12. 5X 

2.  How  often 

did  you 

get  nuisance  warnings? 

GROUND 

CLOBBER 

GCAS 

LAWS 

ENHANCED  GC 

ALL  THE  TIME 

1/15 

6.7X 

2/16 

12. 5X 

0/16 

O.OX 

1/8 

12. 5X 

MOST  OF  THE 

TIME 

2/15 

13. 3X 

2/16 

12. 5X 

0/16 

o.ox 

0/8 

O.OX 

OCCASIONALLY 

2/15 

13. 3X 

3/16 

18. 8X 

2/16 

12. 5X 

1/8 

12.5% 

SELDOM 

5/15 

33. 3X 

7/16 

43. 7X 

4/16 

25. OX 

4/8 

50.  OX 

NEVER 

5/15 

33. 3X 

2/16 

12. 5X 

10/16 

62. 5X 

2/8 

25. OX 

3.  Did  the  Warning  System  get  your  attention? 


GROUND  CLOBBER  GCAS  LAWS  ENHANCED  GC 


YES,  ALL  THE 


TIME 

16/22 

73. OX 

21/24 

87. 5X 

19/24 

79. 2X 

6/8 

75. OX 

YES,  MOST  OF 

THE  TIME 

6/22 

27. OX 

3/24 

12. 5X 

5/24 

20. 8X 

2/8 

25 . 0% 

OCCAS IONALLY 

0/22 

O.OX 

0/24 

O.OX 

0/24 

o.ox 

0 

0.0% 

SELDOM 

0/22 

O.OX 

0/24 

O.OX 

0/24 

O.OX 

0 

O.OX 

NEVER 

0/22 

O.OX 

0/24 

o.ox 

0/24 

o.ox 

0 

o.ox 

4.  Were  there  any  instance* ,  in  your  opinion,  where  the  system  provided  no 
warning  when  it  should  have? 


0  GROUND  CLudBER 

NO  12/22 
YES  10/22 

oo  Level  flight  into  rising  terrain, 
oo  Wings  level  at  low  dive  angles. 


! 

- 

i 

oo  Hit  ridge  without  a  warning, 
oo  Descending  with  bank  >90  had  no  warning. 

; 

1  o 

I 

i 

i 

j 

GCAS 

NO  14/23 

YES  9/23 

* i 

i 

i 

i 

i 

oo  Laval  flight  into  rising  terrain 
oo  Ridge  clip 

i 

i 

i  0 

i 

i 

LAWS 

NO  16/24 

YES  8/24 

i 

i 

i 

oo  Hit  ridga  without  a  warning 
oo  No  warning  when  ovarbanked 

NO  4/8 

YES  4/8 

oo  Wings  level  descent  of  2  -4  resulted  in  crash  without 

warning. 

oo  Level  flight  into  rising  terrain 
oo  Hit  ridga  with  no  warning 

1 

1 

5. 

ADDITIONAL  COMMENTS: 

0  GROUND  CLOBBER 

1 

1 

» 

i 

i 

oo  Anticipation  cue  is  a  plus  (5). 

oo  Anticipation  cue  could  be  a  bit  longer. 

oo  Confused  the  anticipation  cue  with  fuze  aiming  symbol. 

oo  Warning  was  early  during  high  dives. 

oo  Most  warnings  occurred  during  bunts. 

1 

■i 

i 

i 

0  GCA  8 

1 

1 

i 

i 

i 

l 

•f  • 

0  LAWS 

oo  Pushing  over  che  backside  of  ridges  you  often  get  false  warnings 
(2). 

oo  Warnings  initiated  slightly  early. 

oo  Saveral  nuisance  warnings  in  a  row  for  no  apparent  reason. 

:  1 
, 

1 

{. 

f; 

f 

i 

oo  When  manuevaring  over  ridga  lines  and  through  mountain  gaps  I'd 
seldom-to-never  get  a  warning. 

oo  Generally  fait  warning  system  provided  good  warnings  against 
gradually  rising  tarrain  or  due  to  inattention, 
oo  Nuisance  warnings  on  boobing. 
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